Sep 28 14:52:55 devstack cinder-volume[74935]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:52:55 devstack cinder-volume[74935]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:52:55 devstack cinder-volume[74935]: we strongly recommend against using it for new projects. Sep 28 14:52:55 devstack cinder-volume[74935]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:52:55 devstack cinder-volume[74935]: framework. For more detail see Sep 28 14:52:55 devstack cinder-volume[74935]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:52:55 devstack cinder-volume[74935]: import eventlet # noqa Sep 28 14:52:58 devstack cinder-volume[74935]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:52:58 devstack cinder-volume[74935]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:52:58 devstack cinder-volume[74935]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:52:59 devstack cinder-volume[74935]: INFO dbcounter [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Registered counter for database cinder Sep 28 14:52:59 devstack cinder-volume[74935]: DEBUG oslo_db.sqlalchemy.engines [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:52:59 devstack cinder-volume[74935]: DEBUG dbcounter [-] [74935] Writer thread running {{(pid=74935) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:52:59 devstack cinder-volume[74935]: INFO cinder.rpc [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:52:59 devstack cinder-volume[74935]: INFO cinder.rpc [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:52:59 devstack cinder-volume[74935]: DEBUG oslo_db.sqlalchemy.engines [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:52:59 devstack cinder-volume[74935]: INFO cinder.volume.manager [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Determined volume DB was empty at startup. Sep 28 14:52:59 devstack cinder-volume[74935]: DEBUG cinder.volume.manager [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74935) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:52:59 devstack cinder-volume[74935]: INFO cinder.volume.manager [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:52:59 devstack cinder-volume[74935]: WARNING stevedore.named [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:52:59 devstack cinder-volume[74935]: WARNING castellan.key_manager [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:52:59 devstack cinder-volume[74935]: WARNING cinder.keymgr.conf_key_mgr [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:52:59 devstack cinder-volume[74935]: DEBUG cinder.volume.drivers.lvm [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74935) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 14:52:59 devstack cinder-volume[74935]: DEBUG oslo_concurrency.processutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74935) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_concurrency.processutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.474s {{(pid=74935) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_db.sqlalchemy.engines [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:00 devstack cinder-volume[74935]: INFO cinder.rpc [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 14:53:00 devstack cinder-volume[74935]: INFO cinder.rpc [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 14:53:00 devstack cinder-volume[74935]: WARNING stevedore.named [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:53:00 devstack cinder-volume[74935]: WARNING castellan.key_manager [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:53:00 devstack cinder-volume[74935]: INFO cinder.volume.manager [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_db.sqlalchemy.engines [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:00 devstack cinder-volume[74935]: INFO oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Starting 1 workers Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Started child 75068 {{(pid=74935) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Full set of CONF: {{(pid=74935) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] ******************************************************************************** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Configuration options gathered from: {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] ================================================================================ {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] allow_availability_zone_fallback = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] allow_compression_on_image_upload = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] allowed_direct_url_schemes = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] api_rate_limit = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] auth_strategy = keystone {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] az_cache_duration = 3600 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_availability_zone = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_host = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_stats_polling_interval = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backup_api_class = cinder.backup.api.API {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backup_name_template = backup-%s {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backup_use_same_host = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backup_use_temp_snapshot = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] chap_password = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] chap_username = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_internal_tenant_project_id = 71dbeef4525a4c12bc823a89a8469d39 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_internal_tenant_user_id = 0bd9c28c39554681acc04a0c51fbb5d0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cloned_volume_same_az = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[75068]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cluster = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] compression_format = gzip {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] config_dir = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] config_source = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] control_exchange = openstack {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] debug = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] default_availability_zone = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] default_group_type = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] default_volume_type = lvmdriver-1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] disk_geometry = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] driver_client_cert = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] driver_client_cert_key = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] driver_data_namespace = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] driver_ssl_cert_path = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] driver_ssl_cert_verify = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] driver_use_ssl = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] enable_force_upload = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] enable_new_services = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] enable_unsupported_driver = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] enforce_multipath_for_image_xfer = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] filter_function = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_api_insecure = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_api_servers = ['http://192.168.122.223/image'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_api_ssl_compression = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_ca_certificates_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_num_retries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance_request_timeout = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] goodness_function = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] graceful_shutdown_timeout = 5 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] group_api_class = cinder.group.api.API {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] host = devstack {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_compress_on_upload = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_conversion_address_space_limit = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_conversion_cpu_limit = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_conversion_disable = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_introspection_address_space_limit = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_introspection_cpu_limit = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_upload_use_cinder_backend = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_upload_use_internal_tenant = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_volume_cache_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_volume_cache_max_count = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] init_host_max_objects_retrieval = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] instance_format = [instance: %(uuid)s] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] iscsi_target_flags = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] iscsi_write_cache = on {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] iser_helper = tgtadm {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] iser_ip_address = 192.168.122.223 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] iser_port = 3260 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_color = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_config_append = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_dir = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_options = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_rotate_interval = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_rotate_interval_type = days {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] log_rotation_type = none {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] max_age = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] max_logfile_count = 30 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] max_logfile_size_mb = 200 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] max_over_subscription_ratio = 20.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] message_reap_interval = 86400 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] message_ttl = 2592000 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] monkey_patch = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] monkey_patch_modules = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] my_ip = 192.168.122.223 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] no_snapshot_gb_quota = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] num_iser_scan_tries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] num_shell_tries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] num_volume_device_scan_tries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] nvmeof_conn_info_version = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] nvmet_ns_id = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] nvmet_port_id = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] osapi_max_limit = 1000 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] osapi_volume_ext_list = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] osapi_volume_listen_port = 8776 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] osapi_volume_use_ssl = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] osapi_volume_workers = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] per_volume_size_limit = -1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] periodic_fuzzy_delay = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] periodic_interval = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] public_endpoint = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] publish_errors = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] quota_backup_gigabytes = 1000 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] quota_backups = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] quota_gigabytes = 1000 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] quota_groups = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] quota_snapshots = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] quota_volumes = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] rate_limit_burst = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] rate_limit_except_level = CRITICAL {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] rate_limit_interval = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] reinit_driver_count = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] replication_device = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] report_discard_supported = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] report_interval = 120 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] reservation_clean_interval = 86400 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] reservation_expire = 86400 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] reserved_image_namespaces = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] reserved_percentage = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] rpc_response_timeout = 120 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] run_external_periodic_tasks = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] scst_target_driver = iscsi {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] scst_target_iqn_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_down_time = 720 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] shell_completion = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] snapshot_name_template = snapshot-%s {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] snapshot_same_host = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] split_loggers = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] state_path = /opt/stack/data/cinder {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] storage_availability_zone = nova {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] storage_protocol = iSCSI {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] syslog_log_facility = LOG_USER {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] target_helper = lioadm {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] target_ip_address = 192.168.122.223 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] target_port = 3260 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] target_protocol = iscsi {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] target_secondary_ip_addresses = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] trace_flags = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] transport_url = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] until_refresh = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] use_chap_auth = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] use_default_quota_class = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] use_journal = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] use_json = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] use_multipath_for_image_xfer = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] use_stderr = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] use_syslog = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] verify_glance_signatures = enabled {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_api_class = cinder.volume.api.API {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_backend_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_clear = zero {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_clear_ionice = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_clear_size = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_copy_bps_limit = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_dd_blocksize = 1M {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_name_template = volume-%s {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_service_inithost_offload = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volume_usage_audit_period = month {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] zoning_mode = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.auth_section = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.auth_type = password {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.auth_version = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.cache = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.insecure = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.interface = public {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_password = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcache_username = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.region_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.service_type = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.223/identity {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.backend = dogpile.cache.null {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.backend_argument = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.backend_expiration_time = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.config_prefix = cache.oslo {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.debug_cache_backend = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.enable_retry_client = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.enable_socket_keepalive = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.expiration_time = 600 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.memcache_dead_retry = 300 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.memcache_sasl_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.password = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.proxies = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.redis_db = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.redis_server = localhost:6379 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.retry_attempts = 2 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.retry_delay = 0.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.socket_keepalive_count = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.socket_keepalive_idle = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.socket_keepalive_interval = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.socket_timeout = 1.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.tls_allowed_ciphers = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.tls_cafile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.tls_certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.tls_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.tls_keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cache.username = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] coordination.backend_url = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.asyncio_connection = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.asyncio_slave_connection = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.backend = sqlalchemy {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.connection = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.connection_debug = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.connection_parameters = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[75068]: INFO cinder.volume.manager [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 14:53:00 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.connection_recycle_time = 3600 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.connection_trace = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.db_inc_retry_interval = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.db_max_retries = 20 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.db_max_retry_interval = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.db_retry_interval = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:00 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.max_overflow = 50 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.max_pool_size = 5 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.max_retries = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.pool_timeout = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.retry_interval = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.slave_connection = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.sqlite_synchronous = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.synchronous_reader = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] database.use_db_reconnect = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_tracing.insecure = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.connection_string = messaging:// {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.es_doc_type = notification {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.es_scroll_size = 10000 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.es_scroll_time = 2m {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.filter_error_trace = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.hmac_keys = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.sentinel_service_name = mymaster {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.socket_timeout = 0.1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.trace_requests = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler.trace_sqlalchemy = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler_jaeger.process_tags = {} {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] profiler_otlp.service_name_prefix = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.policy_default_rule = default {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] privsep_osbrick.group = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] privsep_osbrick.helper_command = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] privsep_osbrick.user = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_sys_admin.group = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_sys_admin.helper_command = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] cinder_sys_admin.user = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.auth_section = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.auth_type = password {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.cafile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.collect_timing = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.insecure = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.send_service_user_token = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.split_loggers = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.timeout = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.tls_ciphers = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] service_user.tls_min_version = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.auth_section = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.auth_type = password {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.collect_timing = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.insecure = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.region_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.split_loggers = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.timeout = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.tls_ciphers = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] glance.tls_min_version = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.backend_availability_zone = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.chap_password = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.chap_username = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.disk_geometry = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.driver_client_cert = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.driver_data_namespace = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.driver_use_ssl = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.extra_capabilities = {} {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.filter_function = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.goodness_function = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.iscsi_target_flags = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.iser_ip_address = 192.168.122.223 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.iser_port = 3260 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.lvm_share_target = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.lvm_type = auto {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.replication_device = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.report_discard_supported = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.target_helper = tgtadm {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.target_ip_address = 192.168.122.223 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.target_port = 3260 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.target_protocol = iscsi {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.trace_flags = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.use_chap_auth = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_backend_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_clear = zero {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_reports.file_event_handler = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_reports.log_dir = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.backend_host = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.chap_password = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.chap_username = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.disk_geometry = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.driver_client_cert = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.extra_capabilities = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.filter_function = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.goodness_function = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.iser_helper = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.iser_ip_address = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.iser_port = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.lvm_share_target = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.lvm_type = auto {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.num_shell_tries = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.replication_device = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.report_discard_supported = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.reserved_percentage = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.scst_target_driver = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.storage_protocol = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.target_helper = lioadm {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.target_ip_address = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.target_port = 3260 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.trace_flags = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.use_chap_auth = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_clear = zero {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_clear_size = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] lvmdriver-1.volumes_dir = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.069s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_notifications.driver = [] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] key_manager.fixed_key = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.barbican_api_version = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.barbican_endpoint = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.barbican_endpoint_type = public {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.barbican_region_name = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.cafile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.collect_timing = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.insecure = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.number_of_retries = 60 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.retry_delay = 1 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.send_service_user_token = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.split_loggers = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.timeout = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.tls_ciphers = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.tls_min_version = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.verify_ssl = True {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican.verify_ssl_path = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.auth_section = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.auth_type = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.cafile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.certfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.collect_timing = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.insecure = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.keyfile = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.split_loggers = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.timeout = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.tls_ciphers = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] barbican_service_user.tls_min_version = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.approle_role_id = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.approle_secret_id = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.066s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.auth_method = approle {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.auth_path = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.kv_mountpoint = secret {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.kv_path = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.kv_version = 2 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.namespace = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.root_token_id = **** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.ssl_ca_crt_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.timeout = 60.0 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.token_file = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.token_role = None {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.use_ssl = False {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:01 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] ******************************************************************************** {{(pid=74935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:53:01 devstack sudo[75072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 14:53:01 devstack sudo[75072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:01 devstack sudo[75072]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:01 devstack sudo[75144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:01 devstack sudo[75144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:01 devstack sudo[75144]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.312s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 14:53:01 devstack cinder-volume[75068]: INFO cinder.brick.local_dev.lvm [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:01 devstack sudo[75276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:01 devstack sudo[75276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:02 devstack sudo[75276]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:02 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:02 devstack cinder-volume[75068]: DEBUG cinder.brick.local_dev.lvm [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75068) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 14:53:02 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:02 devstack sudo[75362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:02 devstack sudo[75362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:02 devstack sudo[75362]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:02 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:02 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:02 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:02 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:02 devstack sudo[75549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:02 devstack sudo[75549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:03 devstack sudo[75549]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:03 devstack sudo[75661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 14:53:03 devstack sudo[75661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:03 devstack sudo[75661]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.285s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:03 devstack sudo[75687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:03 devstack sudo[75687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:03 devstack sudo[75687]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:03 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:03 devstack sudo[75745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:03 devstack sudo[75745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:04 devstack sudo[75745]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:04 devstack sudo[75774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:04 devstack sudo[75774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:04 devstack sudo[75774]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:04 devstack sudo[75816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:04 devstack sudo[75816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:04 devstack sudo[75816]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.351s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:04 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:04 devstack sudo[75867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:04 devstack sudo[75867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:05 devstack sudo[75867]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:05 devstack cinder-volume[75068]: INFO cinder.volume.drivers.lvm [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:05 devstack sudo[75871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:05 devstack sudo[75871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:05 devstack sudo[75871]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG cinder.volume.drivers.lvm [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Updating volume stats {{(pid=75068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:05 devstack sudo[75875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:05 devstack sudo[75875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:05 devstack sudo[75875]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:05 devstack sudo[75884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:05 devstack sudo[75884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:05 devstack sudo[75884]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:05 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:05 devstack sudo[75887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:05 devstack sudo[75887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:06 devstack sudo[75887]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:06 devstack sudo[75890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:06 devstack sudo[75890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:06 devstack sudo[75890]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:06 devstack cinder-volume[75068]: INFO cinder.volume.driver [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG cinder.volume.driver [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75068) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG oslo_db.sqlalchemy.engines [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG dbcounter [-] [75068] Writer thread running {{(pid=75068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG cinder.db.api [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Building query based on filter {{(pid=75068) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG cinder.image.image_utils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75068) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:53:06 devstack cinder-volume[75068]: INFO cinder.keymgr.migration [None req-5161265c-a2c4-4e6d-b542-e6516962184f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG cinder.volume.drivers.lvm [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Updating volume stats {{(pid=75068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:06 devstack sudo[75895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:06 devstack sudo[75895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:06 devstack sudo[75895]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:06 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:06 devstack sudo[75898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:06 devstack sudo[75898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:07 devstack sudo[75898]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:07 devstack sudo[75903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:07 devstack sudo[75903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:07 devstack sudo[75903]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:07 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:07 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:07 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG cinder.manager [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Notifying Schedulers of capabilities ... {{(pid=75068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:53:07 devstack cinder-volume[75068]: INFO cinder.volume.manager [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Driver initialization completed successfully. Sep 28 14:53:07 devstack cinder-volume[75068]: INFO cinder.manager [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Initiating service 2 cleanup Sep 28 14:53:07 devstack cinder-volume[75068]: INFO cinder.manager [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Service 2 cleanup completed. Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG cinder.service [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Creating RPC server for service cinder-volume {{(pid=75068) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG cinder.service [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75068) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:53:07 devstack cinder-volume[75068]: INFO cinder.volume.manager [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG cinder.volume.drivers.lvm [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Updating volume stats {{(pid=75068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:07 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:08 devstack sudo[75910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:08 devstack sudo[75910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:08 devstack sudo[75910]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:08 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:08 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:08 devstack sudo[75913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:08 devstack sudo[75913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:08 devstack sudo[75913]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:08 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.356s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:08 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:08 devstack sudo[75918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:08 devstack sudo[75918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:08 devstack sudo[75918]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:08 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:09 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:09 devstack sudo[75921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:09 devstack sudo[75921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:09 devstack sudo[75921]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:09 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:09 devstack cinder-volume[75068]: INFO cinder.volume.manager [None req-b9b66afd-c6df-4c0d-a9df-d4e8c8ee43c6 None None] Driver post RPC initialization completed successfully. Sep 28 14:53:10 devstack cinder-volume[74935]: DEBUG dbcounter [-] [74935] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74935) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:19 devstack cinder-volume[75068]: DEBUG dbcounter [-] [75068] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:19 devstack cinder-volume[75068]: DEBUG dbcounter [-] [75068] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:32 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager._thread_info {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:53:32 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread count: 6 {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:53:32 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread info: [<_MainThread(MainThread, started 129818506920064)>, , , , , ] {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:54:32 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:32 devstack cinder-volume[75068]: DEBUG cinder.volume.drivers.lvm [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Updating volume stats {{(pid=75068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:54:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:32 devstack sudo[78474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:54:32 devstack sudo[78474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:32 devstack sudo[78474]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:32 devstack sudo[78477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:32 devstack sudo[78477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:32 devstack sudo[78477]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:32 devstack sudo[78480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:54:32 devstack sudo[78480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:33 devstack sudo[78480]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:33 devstack sudo[78484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:33 devstack sudo[78484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:33 devstack sudo[78484]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:33 devstack cinder-volume[75068]: DEBUG cinder.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Notifying Schedulers of capabilities ... {{(pid=75068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:33 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager._thread_info {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:33 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread count: 6 {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:54:33 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread info: [<_MainThread(MainThread, started 129818506920064)>, , , , , ] {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:55:19 devstack cinder-volume[75068]: DEBUG dbcounter [-] [75068] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:55:32 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:32 devstack cinder-volume[75068]: DEBUG cinder.volume.drivers.lvm [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Updating volume stats {{(pid=75068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:55:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:32 devstack sudo[81851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:55:32 devstack sudo[81851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:32 devstack sudo[81851]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:32 devstack sudo[81855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:32 devstack sudo[81855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:32 devstack sudo[81855]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:33 devstack sudo[81859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:55:33 devstack sudo[81859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:33 devstack sudo[81859]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:33 devstack sudo[81867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:33 devstack sudo[81867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:33 devstack sudo[81867]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:33 devstack cinder-volume[75068]: DEBUG cinder.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Notifying Schedulers of capabilities ... {{(pid=75068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:33 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager._thread_info {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:33 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread count: 6 {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:55:33 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread info: [<_MainThread(MainThread, started 129818506920064)>, , , , , ] {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:56:32 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:32 devstack cinder-volume[75068]: DEBUG cinder.volume.drivers.lvm [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Updating volume stats {{(pid=75068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:56:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:32 devstack sudo[83766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:56:32 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:32 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:32 devstack sudo[83769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:56:32 devstack sudo[83769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:32 devstack sudo[83769]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:32 devstack sudo[83783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:56:32 devstack sudo[83783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:33 devstack sudo[83783]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:33 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:56:33 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:33 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:33 devstack cinder-volume[75068]: DEBUG cinder.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Notifying Schedulers of capabilities ... {{(pid=75068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:33 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager._thread_info {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:33 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread count: 6 {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:56:33 devstack cinder-volume[75068]: DEBUG cinder.volume.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] thread info: [<_MainThread(MainThread, started 129818506920064)>, , , , , ] {{(pid=75068) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:57:19 devstack cinder-volume[75068]: DEBUG dbcounter [-] [75068] Writing DB stats cinder:SELECT=1 {{(pid=75068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:19 devstack cinder-volume[75068]: DEBUG dbcounter [-] [75068] Writing DB stats cinder:UPDATE=1 {{(pid=75068) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:32 devstack cinder-volume[75068]: DEBUG oslo_service.periodic_task [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75068) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:32 devstack cinder-volume[75068]: DEBUG cinder.volume.drivers.lvm [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Updating volume stats {{(pid=75068) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:57:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:32 devstack sudo[84840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:57:32 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:32 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:32 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:57:32 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:32 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:32 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:33 devstack sudo[84846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:57:33 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:33 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:33 devstack sudo[84852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:57:33 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:33 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:33 devstack cinder-volume[75068]: DEBUG oslo_concurrency.processutils [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=75068) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:33 devstack cinder-volume[75068]: DEBUG cinder.manager [None req-2ac26b94-10bd-43bd-a6a9-6d4debc47677 None None] Notifying Schedulers of capabilities ... {{(pid=75068) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:05 devstack cinder-volume[74935]: INFO oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Caught SIGTERM, stopping children Sep 28 14:58:05 devstack cinder-volume[74935]: DEBUG oslo_concurrency.lockutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Acquiring lock "singleton_lock" {{(pid=74935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:05 devstack cinder-volume[74935]: DEBUG oslo_concurrency.lockutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Acquired lock "singleton_lock" {{(pid=74935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:05 devstack cinder-volume[74935]: DEBUG oslo_concurrency.lockutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Releasing lock "singleton_lock" {{(pid=74935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:05 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Stop services. {{(pid=74935) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:58:05 devstack cinder-volume[74935]: DEBUG oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Killing children. {{(pid=74935) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:58:05 devstack cinder-volume[74935]: INFO oslo_service.backend._eventlet.service [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Waiting on 1 children to exit Sep 28 14:58:11 devstack cinder-volume[75068]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 14:58:11 devstack cinder-volume[85508]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:58:11 devstack cinder-volume[85508]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:58:11 devstack cinder-volume[85508]: we strongly recommend against using it for new projects. Sep 28 14:58:11 devstack cinder-volume[85508]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:58:11 devstack cinder-volume[85508]: framework. For more detail see Sep 28 14:58:11 devstack cinder-volume[85508]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:58:11 devstack cinder-volume[85508]: import eventlet # noqa Sep 28 14:58:12 devstack cinder-volume[75068]: DEBUG oslo_concurrency.lockutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Acquiring lock "singleton_lock" {{(pid=75068) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:12 devstack cinder-volume[75068]: DEBUG oslo_concurrency.lockutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Acquired lock "singleton_lock" {{(pid=75068) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:12 devstack cinder-volume[75068]: DEBUG oslo_concurrency.lockutils [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Releasing lock "singleton_lock" {{(pid=75068) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:12 devstack cinder-volume[75068]: WARNING amqp [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:12 devstack cinder-volume[75068]: WARNING amqp [None req-37b1a373-c3d5-4710-a89b-491fdd9746d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:13 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:13 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:13 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:14 devstack cinder-volume[85508]: INFO dbcounter [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Registered counter for database cinder Sep 28 14:58:14 devstack cinder-volume[85508]: DEBUG oslo_db.sqlalchemy.engines [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG dbcounter [-] [85508] Writer thread running {{(pid=85508) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:15 devstack cinder-volume[85508]: INFO cinder.rpc [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:58:15 devstack cinder-volume[85508]: INFO cinder.rpc [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_db.sqlalchemy.engines [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:15 devstack cinder-volume[85508]: INFO cinder.volume.manager [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Determined volume DB was empty at startup. Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG cinder.volume.manager [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85508) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:58:15 devstack cinder-volume[85508]: INFO cinder.volume.manager [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:58:15 devstack cinder-volume[85508]: WARNING stevedore.named [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:58:15 devstack cinder-volume[85508]: WARNING castellan.key_manager [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:15 devstack cinder-volume[85508]: WARNING cinder.keymgr.conf_key_mgr [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:15 devstack cinder-volume[85508]: INFO cinder.volume.manager [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_db.sqlalchemy.engines [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:15 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Starting 1 workers Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Started child 85727 {{(pid=85508) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Full set of CONF: {{(pid=85508) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] ******************************************************************************** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Configuration options gathered from: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] ================================================================================ {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] allow_availability_zone_fallback = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] allow_compression_on_image_upload = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] allowed_direct_url_schemes = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] api_rate_limit = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] auth_strategy = keystone {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_availability_zone = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_host = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_stats_polling_interval = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backup_api_class = cinder.backup.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backup_name_template = backup-%s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backup_use_same_host = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backup_use_temp_snapshot = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] chap_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] chap_username = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_internal_tenant_project_id = 71dbeef4525a4c12bc823a89a8469d39 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_internal_tenant_user_id = 0bd9c28c39554681acc04a0c51fbb5d0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85727]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cluster = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] compression_format = gzip {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] compute_api_class = cinder.compute.nova.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] config_dir = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] config_source = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] control_exchange = openstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] debug = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] default_availability_zone = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] default_group_type = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] default_volume_type = QuobyteHD {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] disk_geometry = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] driver_client_cert = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] driver_client_cert_key = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] driver_data_namespace = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] driver_ssl_cert_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] driver_ssl_cert_verify = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] driver_use_ssl = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] enable_new_services = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] enable_unsupported_driver = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] enabled_backends = ['QuobyteHD'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] enforce_multipath_for_image_xfer = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] filter_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_api_insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_api_servers = ['http://192.168.122.223/image'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_api_ssl_compression = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_ca_certificates_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_catalog_info = image:glance:publicURL {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_num_retries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance_request_timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] goodness_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] graceful_shutdown_timeout = 5 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] group_api_class = cinder.group.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] host = devstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_compress_on_upload = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_conversion_address_space_limit = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_conversion_cpu_limit = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_conversion_disable = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_introspection_address_space_limit = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_introspection_cpu_limit = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_upload_use_cinder_backend = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_upload_use_internal_tenant = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_volume_cache_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_volume_cache_max_count = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] image_volume_cache_max_size_gb = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] init_host_max_objects_retrieval = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] instance_format = [instance: %(uuid)s] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] iscsi_target_flags = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] iscsi_write_cache = on {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] iser_helper = tgtadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] iser_ip_address = 192.168.122.223 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] iser_port = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_color = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_config_append = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_dir = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_options = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_rotate_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_rotate_interval_type = days {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] log_rotation_type = none {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] max_age = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] max_logfile_count = 30 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] max_logfile_size_mb = 200 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] max_over_subscription_ratio = 20.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] message_reap_interval = 86400 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] message_ttl = 2592000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] migration_create_volume_timeout_secs = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] monkey_patch = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] monkey_patch_modules = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] my_ip = 192.168.122.223 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] no_snapshot_gb_quota = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] num_iser_scan_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] num_shell_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] num_volume_device_scan_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] nvmeof_conn_info_version = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] nvmet_ns_id = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] nvmet_port_id = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] osapi_max_limit = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] osapi_volume_ext_list = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] osapi_volume_listen_port = 8776 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] osapi_volume_use_ssl = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] osapi_volume_workers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] per_volume_size_limit = -1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] periodic_fuzzy_delay = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] periodic_interval = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] public_endpoint = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] publish_errors = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] quota_backup_gigabytes = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] quota_backups = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] quota_gigabytes = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] quota_groups = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] quota_snapshots = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] quota_volumes = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85727]: INFO cinder.volume.manager [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.remotefs [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85727) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] rate_limit_burst = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] rate_limit_except_level = CRITICAL {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] rate_limit_interval = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] reinit_driver_count = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] replication_device = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] report_discard_supported = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] report_interval = 120 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] reservation_clean_interval = 86400 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] reservation_expire = 86400 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] reserved_image_namespaces = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] reserved_percentage = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] rpc_response_timeout = 120 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] run_external_periodic_tasks = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] scst_target_driver = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] scst_target_iqn_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_down_time = 720 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] shell_completion = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] snapshot_name_template = snapshot-%s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] split_loggers = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] state_path = /opt/stack/data/cinder {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] storage_availability_zone = nova {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] storage_protocol = iSCSI {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] syslog_log_facility = LOG_USER {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] target_helper = lioadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] target_ip_address = 192.168.122.223 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] target_port = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] target_protocol = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] target_secondary_ip_addresses = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] trace_flags = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] transport_url = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] until_refresh = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] use_chap_auth = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] use_default_quota_class = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] use_journal = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] use_json = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] use_multipath_for_image_xfer = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] use_stderr = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] use_syslog = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] verify_glance_signatures = enabled {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_api_class = cinder.volume.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_backend_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_clear = zero {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_clear_ionice = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_clear_size = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_copy_bps_limit = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_dd_blocksize = 1M {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_name_template = volume-%s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_service_inithost_offload = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volume_usage_audit_period = month {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] zoning_mode = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_concurrency.disable_process_locking = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.auth_section = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.auth_type = password {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.auth_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.cache = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85727) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:58:15 devstack cinder-volume[85727]: WARNING cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:58:15 devstack cinder-volume[85727]: WARNING cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.include_service_catalog = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.interface = public {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Running cmd (subprocess): mount.quobyte {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcache_username = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.region_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.service_type = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.223/identity {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.backend = dogpile.cache.null {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.backend_argument = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.backend_expiration_time = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.config_prefix = cache.oslo {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.debug_cache_backend = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.enable_retry_client = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.enable_socket_keepalive = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.expiration_time = 600 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.hashclient_retry_attempts = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.memcache_dead_retry = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.memcache_pool_maxsize = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.memcache_sasl_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.proxies = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.redis_db = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.redis_server = localhost:6379 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.retry_attempts = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.retry_delay = 0.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.socket_keepalive_count = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.socket_keepalive_idle = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.socket_keepalive_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.socket_timeout = 1.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.tls_allowed_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.tls_cafile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.tls_certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.tls_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.tls_keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cache.username = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] coordination.backend_url = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.asyncio_connection = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.asyncio_slave_connection = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.backend = sqlalchemy {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.connection = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.connection_debug = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.connection_parameters = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.connection_recycle_time = 3600 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.connection_trace = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.db_inc_retry_interval = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.db_max_retries = 20 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.db_max_retry_interval = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.db_retry_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.max_overflow = 50 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.max_pool_size = 5 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.max_retries = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.mysql_wsrep_sync_wait = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.pool_timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.retry_interval = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.slave_connection = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.sqlite_synchronous = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.synchronous_reader = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] database.use_db_reconnect = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_tracing.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.connection_string = messaging:// {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.es_doc_type = notification {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.es_scroll_size = 10000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.es_scroll_time = 2m {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.filter_error_trace = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.hmac_keys = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.sentinel_service_name = mymaster {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.socket_timeout = 0.1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.trace_requests = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler.trace_sqlalchemy = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler_jaeger.process_tags = {} {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler_jaeger.service_name_prefix = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] profiler_otlp.service_name_prefix = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.enforce_new_defaults = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.policy_default_rule = default {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.policy_file = policy.yaml {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack quobyte-client[85732]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:58:15 devstack quobyte-client[85732]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=85727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] privsep_osbrick.group = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] privsep_osbrick.helper_command = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85727]: INFO cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d ... Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] privsep_osbrick.user = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c -c /etc/quobyte/client-cinder.cfg {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_sys_admin.group = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_sys_admin.helper_command = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] cinder_sys_admin.user = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.auth_section = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.auth_type = password {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.cafile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.collect_timing = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.send_service_user_token = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.split_loggers = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.tls_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] service_user.tls_min_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.auth_section = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.auth_type = password {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.collect_timing = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.region_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.split_loggers = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.tls_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] glance.tls_min_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.backend_availability_zone = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.chap_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.chap_username = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.disk_geometry = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.driver_client_cert = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.driver_client_cert_key = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.driver_data_namespace = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c -c /etc/quobyte/client-cinder.cfg Sep 28 14:58:15 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.driver_use_ssl = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.extra_capabilities = {} {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.filter_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.goodness_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.iscsi_target_flags = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.iscsi_write_cache = on {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.iser_helper = tgtadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.iser_ip_address = 192.168.122.223 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.iser_port = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_host = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_login = admin {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_mount_options = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_private_key = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_share_path = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.num_shell_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.quobyte_volume_url = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.replication_device = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.report_discard_supported = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.reserved_percentage = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.target_helper = tgtadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.target_ip_address = 192.168.122.223 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.target_port = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.target_protocol = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.trace_flags = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.unique_fqdn_network = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.use_chap_auth = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_backend_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_clear = zero {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_clear_ionice = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_clear_size = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_reports.file_event_handler = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_reports.log_dir = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.backend_availability_zone = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.backend_host = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.chap_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.chap_username = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.chiscsi_conf = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.disk_geometry = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.driver_client_cert = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.driver_data_namespace = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.driver_use_ssl = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.extra_capabilities = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.filter_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.goodness_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.iser_helper = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.iser_ip_address = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.iser_port = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.iser_target_prefix = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_host = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_login = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_mount_options = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_private_key = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_share_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_ssh_port = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.num_shell_tries = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.nvmet_port_id = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.replication_device = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.report_discard_supported = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.reserved_percentage = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.scst_target_driver = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.storage_protocol = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.target_helper = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.target_ip_address = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.target_port = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.target_prefix = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.target_protocol = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.trace_flags = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.use_chap_auth = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_clear = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_clear_size = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] QuobyteHD.volumes_dir = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.ssl = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_notifications.driver = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_notifications.retry = -1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] key_manager.fixed_key = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.barbican_api_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.barbican_endpoint = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.barbican_endpoint_type = public {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.barbican_region_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.cafile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.collect_timing = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.number_of_retries = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.retry_delay = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.send_service_user_token = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.split_loggers = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.tls_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.tls_min_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.verify_ssl = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican.verify_ssl_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.auth_section = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.auth_type = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.cafile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.collect_timing = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.split_loggers = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.tls_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] barbican_service_user.tls_min_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.approle_role_id = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.approle_secret_id = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.auth_method = approle {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.auth_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.kv_mountpoint = secret {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.kv_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.kv_version = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.namespace = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.root_token_id = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.ssl_ca_crt_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.timeout = 60.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.token_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.token_role = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.use_ssl = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:15 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] ******************************************************************************** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:58:16 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.453s {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:16 devstack cinder-volume[85727]: INFO cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d succeeded Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=85727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.463s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:16 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:58:16 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:16 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.307s {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:16 devstack cinder-volume[85727]: INFO cinder.volume.driver [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.volume.driver [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85727) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_db.sqlalchemy.engines [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85727) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG dbcounter [-] [85727] Writer thread running {{(pid=85727) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.db.api [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Building query based on filter {{(pid=85727) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.image.image_utils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85727) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:58:16 devstack cinder-volume[85727]: INFO cinder.keymgr.migration [None req-56a90de6-8c41-422f-a871-86172044ada3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=85727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=85727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:16 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:58:16 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:16 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.329s {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.manager [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Notifying Schedulers of capabilities ... {{(pid=85727) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:16 devstack cinder-volume[85727]: INFO cinder.volume.manager [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Driver initialization completed successfully. Sep 28 14:58:16 devstack cinder-volume[85727]: INFO cinder.manager [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Initiating service 3 cleanup Sep 28 14:58:16 devstack cinder-volume[85727]: INFO cinder.manager [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Service 3 cleanup completed. Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.service [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Creating RPC server for service cinder-volume {{(pid=85727) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:58:16 devstack cinder-volume[85727]: DEBUG cinder.service [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85727) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:58:17 devstack cinder-volume[85727]: INFO cinder.volume.manager [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:58:17 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:17 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:17 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=85727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:17 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=85727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:17 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:17 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:17 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:58:17 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:17 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:17 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.367s {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:17 devstack cinder-volume[85727]: INFO cinder.volume.manager [None req-c0e7fb23-9705-45f1-ada0-d18d80d16441 None None] Driver post RPC initialization completed successfully. Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=85727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG cinder.volume.drivers.quobyte [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=85727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:22 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:58:22 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:22 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG oslo_concurrency.processutils [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.303s {{(pid=85727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:22 devstack cinder-volume[85727]: DEBUG cinder.manager [None req-4f620d92-748d-465e-a70f-944127ceeaed None None] Notifying Schedulers of capabilities ... {{(pid=85727) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:22 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Caught SIGTERM, stopping children Sep 28 14:58:22 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Acquiring lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:22 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Acquired lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:22 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Releasing lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:22 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Stop services. {{(pid=85508) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:58:22 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Killing children. {{(pid=85508) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:58:22 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Waiting on 1 children to exit Sep 28 14:58:25 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Acquiring lock "singleton_lock" {{(pid=85727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:25 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Acquired lock "singleton_lock" {{(pid=85727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:25 devstack cinder-volume[85727]: DEBUG oslo_concurrency.lockutils [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Releasing lock "singleton_lock" {{(pid=85727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:25 devstack cinder-volume[85727]: WARNING amqp [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:25 devstack cinder-volume[85727]: WARNING amqp [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:25 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-372c4427-6c26-46a7-8eb7-af3c2ea3a4a8 None None] Child 85727 exited with status 0 Sep 28 14:58:26 devstack cinder-volume[86077]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:58:26 devstack cinder-volume[86077]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:58:26 devstack cinder-volume[86077]: we strongly recommend against using it for new projects. Sep 28 14:58:26 devstack cinder-volume[86077]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:58:26 devstack cinder-volume[86077]: framework. For more detail see Sep 28 14:58:26 devstack cinder-volume[86077]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:58:26 devstack cinder-volume[86077]: import eventlet # noqa Sep 28 14:58:29 devstack cinder-volume[86077]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:29 devstack cinder-volume[86077]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:29 devstack cinder-volume[86077]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:30 devstack cinder-volume[86077]: INFO dbcounter [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Registered counter for database cinder Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_db.sqlalchemy.engines [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG dbcounter [-] [86077] Writer thread running {{(pid=86077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:31 devstack cinder-volume[86077]: INFO cinder.rpc [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:58:31 devstack cinder-volume[86077]: INFO cinder.rpc [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_db.sqlalchemy.engines [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:31 devstack cinder-volume[86077]: INFO cinder.volume.manager [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Determined volume DB was empty at startup. Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG cinder.volume.manager [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86077) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:58:31 devstack cinder-volume[86077]: WARNING stevedore.named [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:58:31 devstack cinder-volume[86077]: WARNING castellan.key_manager [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:31 devstack cinder-volume[86077]: WARNING cinder.keymgr.conf_key_mgr [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:31 devstack cinder-volume[86077]: INFO cinder.volume.manager [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_db.sqlalchemy.engines [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:31 devstack cinder-volume[86077]: INFO oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Starting 1 workers Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Started child 86384 {{(pid=86077) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Full set of CONF: {{(pid=86077) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] ******************************************************************************** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:58:31 devstack cinder-volume[86384]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] Configuration options gathered from: {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] ================================================================================ {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] allow_availability_zone_fallback = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] allow_compression_on_image_upload = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] allowed_direct_url_schemes = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] api_rate_limit = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] auth_strategy = keystone {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_availability_zone = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_host = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_stats_polling_interval = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backup_api_class = cinder.backup.api.API {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backup_name_template = backup-%s {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backup_use_same_host = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backup_use_temp_snapshot = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] chap_password = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] chap_username = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_internal_tenant_project_id = 71dbeef4525a4c12bc823a89a8469d39 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_internal_tenant_user_id = 0bd9c28c39554681acc04a0c51fbb5d0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cluster = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] compression_format = gzip {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] compute_api_class = cinder.compute.nova.API {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] config_dir = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] config_source = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] control_exchange = openstack {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] debug = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] default_availability_zone = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] default_group_type = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] default_volume_type = QuobyteHD {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] disk_geometry = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] driver_client_cert = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] driver_client_cert_key = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] driver_data_namespace = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] driver_ssl_cert_path = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] driver_ssl_cert_verify = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] driver_use_ssl = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] enable_new_services = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] enable_unsupported_driver = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] enabled_backends = ['QuobyteHD'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] enforce_multipath_for_image_xfer = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] filter_function = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_api_insecure = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_api_servers = ['http://192.168.122.223/image'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_api_ssl_compression = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_ca_certificates_file = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_catalog_info = image:glance:publicURL {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_num_retries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance_request_timeout = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] goodness_function = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] graceful_shutdown_timeout = 5 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] group_api_class = cinder.group.api.API {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] host = devstack {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_compress_on_upload = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_conversion_address_space_limit = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_conversion_cpu_limit = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_conversion_disable = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_introspection_address_space_limit = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_introspection_cpu_limit = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:58:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86384) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_upload_use_cinder_backend = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_upload_use_internal_tenant = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_volume_cache_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_volume_cache_max_count = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] image_volume_cache_max_size_gb = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] init_host_max_objects_retrieval = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] instance_format = [instance: %(uuid)s] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] iscsi_target_flags = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] iscsi_write_cache = on {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] iser_helper = tgtadm {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] iser_ip_address = 192.168.122.223 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] iser_port = 3260 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_color = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_config_append = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_dir = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_file = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_options = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_rotate_interval = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_rotate_interval_type = days {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] log_rotation_type = none {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] max_age = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] max_logfile_count = 30 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] max_logfile_size_mb = 200 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] max_over_subscription_ratio = 20.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] message_reap_interval = 86400 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] message_ttl = 2592000 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] migration_create_volume_timeout_secs = 300 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] monkey_patch = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] monkey_patch_modules = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] my_ip = 192.168.122.223 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] no_snapshot_gb_quota = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] num_iser_scan_tries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] num_shell_tries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] num_volume_device_scan_tries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] nvmeof_conn_info_version = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] nvmet_ns_id = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] nvmet_port_id = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] osapi_max_limit = 1000 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:31 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] osapi_volume_ext_list = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] osapi_volume_listen_port = 8776 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] osapi_volume_use_ssl = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] osapi_volume_workers = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] per_volume_size_limit = -1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] periodic_fuzzy_delay = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] periodic_interval = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] public_endpoint = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] publish_errors = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] quota_backup_gigabytes = 1000 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] quota_backups = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] quota_gigabytes = 1000 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] quota_groups = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] quota_snapshots = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] quota_volumes = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] rate_limit_burst = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] rate_limit_except_level = CRITICAL {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] rate_limit_interval = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] reinit_driver_count = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] replication_device = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] report_discard_supported = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] report_interval = 120 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] reservation_clean_interval = 86400 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] reservation_expire = 86400 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] reserved_image_namespaces = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] reserved_percentage = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] rpc_response_timeout = 120 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] run_external_periodic_tasks = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] scst_target_driver = iscsi {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] scst_target_iqn_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_down_time = 720 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] shell_completion = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] snapshot_name_template = snapshot-%s {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] split_loggers = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] state_path = /opt/stack/data/cinder {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] storage_availability_zone = nova {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] storage_protocol = iSCSI {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] syslog_log_facility = LOG_USER {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] target_helper = lioadm {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] target_ip_address = 192.168.122.223 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] target_port = 3260 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] target_protocol = iscsi {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] target_secondary_ip_addresses = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] trace_flags = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] transport_url = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] until_refresh = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] use_chap_auth = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] use_default_quota_class = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] use_journal = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] use_json = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] use_multipath_for_image_xfer = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] use_stderr = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] use_syslog = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] verify_glance_signatures = enabled {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_api_class = cinder.volume.api.API {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_backend_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_clear = zero {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_clear_ionice = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_clear_size = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_copy_bps_limit = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_dd_blocksize = 1M {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_name_template = volume-%s {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_service_inithost_offload = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volume_usage_audit_period = month {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] zoning_mode = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_concurrency.disable_process_locking = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.auth_section = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.auth_type = password {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.auth_version = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.cache = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.include_service_catalog = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.insecure = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.interface = public {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_password = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcache_username = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.region_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.service_type = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.223/identity {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.backend = dogpile.cache.null {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.backend_argument = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.backend_expiration_time = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.config_prefix = cache.oslo {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.debug_cache_backend = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.enable_retry_client = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.enable_socket_keepalive = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.expiration_time = 600 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.hashclient_retry_attempts = 2 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.memcache_dead_retry = 300 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.memcache_pool_maxsize = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.memcache_sasl_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.password = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.proxies = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.redis_db = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.redis_server = localhost:6379 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.retry_attempts = 2 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.retry_delay = 0.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.socket_keepalive_count = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.socket_keepalive_idle = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.socket_keepalive_interval = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.socket_timeout = 1.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.tls_allowed_ciphers = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.tls_cafile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.tls_certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.tls_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.tls_keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cache.username = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] coordination.backend_url = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.asyncio_connection = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.asyncio_slave_connection = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.backend = sqlalchemy {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.connection = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.connection_debug = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.connection_parameters = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.connection_recycle_time = 3600 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.connection_trace = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.db_inc_retry_interval = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.db_max_retries = 20 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.db_max_retry_interval = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.db_retry_interval = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.max_overflow = 50 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.max_pool_size = 5 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.max_retries = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.mysql_wsrep_sync_wait = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.pool_timeout = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.retry_interval = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.slave_connection = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.sqlite_synchronous = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.synchronous_reader = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] database.use_db_reconnect = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86384) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:58:32 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_tracing.insecure = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.connection_string = messaging:// {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Running cmd (subprocess): mount.quobyte {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.es_doc_type = notification {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.es_scroll_size = 10000 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.es_scroll_time = 2m {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.filter_error_trace = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.hmac_keys = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.sentinel_service_name = mymaster {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.socket_timeout = 0.1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.trace_requests = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler.trace_sqlalchemy = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler_jaeger.process_tags = {} {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler_jaeger.service_name_prefix = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] profiler_otlp.service_name_prefix = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.enforce_new_defaults = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.policy_default_rule = default {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.policy_file = policy.yaml {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] privsep_osbrick.group = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] privsep_osbrick.helper_command = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] privsep_osbrick.user = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_sys_admin.group = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_sys_admin.helper_command = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] cinder_sys_admin.user = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.auth_section = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.auth_type = password {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.cafile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.collect_timing = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.insecure = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.send_service_user_token = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.split_loggers = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.timeout = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.tls_ciphers = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] service_user.tls_min_version = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.auth_section = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.auth_type = password {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.collect_timing = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.insecure = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.region_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.split_loggers = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.timeout = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.tls_ciphers = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] glance.tls_min_version = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.backend_availability_zone = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.chap_password = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.chap_username = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.disk_geometry = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.driver_client_cert = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.driver_client_cert_key = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.driver_data_namespace = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.driver_use_ssl = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.extra_capabilities = {} {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.filter_function = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.goodness_function = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.iscsi_target_flags = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.iscsi_write_cache = on {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.iser_helper = tgtadm {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.iser_ip_address = 192.168.122.223 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.iser_port = 3260 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_host = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_login = admin {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_mount_options = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_password = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_private_key = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_share_path = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.num_shell_tries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.quobyte_volume_url = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.replication_device = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.report_discard_supported = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.reserved_percentage = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.target_helper = tgtadm {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.target_ip_address = 192.168.122.223 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.target_port = 3260 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.target_protocol = iscsi {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.trace_flags = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.unique_fqdn_network = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.use_chap_auth = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_backend_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_clear = zero {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_clear_ionice = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_clear_size = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_reports.file_event_handler = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_reports.log_dir = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.backend_availability_zone = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.backend_host = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.chap_password = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.chap_username = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.chiscsi_conf = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.disk_geometry = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.driver_client_cert = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.driver_data_namespace = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.driver_use_ssl = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.extra_capabilities = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.filter_function = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.goodness_function = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.iser_helper = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.iser_ip_address = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.iser_port = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.iser_target_prefix = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_host = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_login = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_mount_options = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_password = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_private_key = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_share_path = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_ssh_port = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.num_shell_tries = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.nvmet_port_id = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.replication_device = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.report_discard_supported = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.reserved_percentage = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.scst_target_driver = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.storage_protocol = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.target_helper = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.target_ip_address = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.target_port = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.target_prefix = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.target_protocol = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.trace_flags = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.use_chap_auth = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_clear = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_clear_size = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] QuobyteHD.volumes_dir = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.ssl = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_notifications.driver = [] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_notifications.retry = -1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] key_manager.fixed_key = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.barbican_api_version = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.barbican_endpoint = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.barbican_endpoint_type = public {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.barbican_region_name = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.cafile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.collect_timing = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.insecure = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.number_of_retries = 60 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.retry_delay = 1 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.send_service_user_token = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.split_loggers = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.timeout = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.tls_ciphers = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.tls_min_version = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.verify_ssl = True {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican.verify_ssl_path = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.auth_section = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.auth_type = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.cafile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.certfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.collect_timing = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.insecure = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.keyfile = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.split_loggers = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.timeout = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.tls_ciphers = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] barbican_service_user.tls_min_version = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.approle_role_id = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.approle_secret_id = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.auth_method = approle {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.auth_path = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.kv_mountpoint = secret {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.kv_path = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.kv_version = 2 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.namespace = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.root_token_id = **** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.ssl_ca_crt_file = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.timeout = 60.0 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.token_file = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.token_role = None {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.use_ssl = False {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:32 devstack cinder-volume[86077]: DEBUG oslo_service.backend._eventlet.service [None req-9bda6433-5748-484c-87b8-a8c501c6b41d None None] ******************************************************************************** {{(pid=86077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:58:32 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.395s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:32 devstack cinder-volume[86384]: INFO cinder.volume.driver [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.volume.driver [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86384) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_db.sqlalchemy.engines [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86384) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writer thread running {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.db.api [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Building query based on filter {{(pid=86384) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86384) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:32 devstack cinder-volume[86384]: INFO cinder.keymgr.migration [None req-3e539478-86ba-4a2b-aa64-825910239a03 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:58:32 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:58:32 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:33 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.382s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:33 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Driver initialization completed successfully. Sep 28 14:58:33 devstack cinder-volume[86384]: INFO cinder.manager [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Initiating service 3 cleanup Sep 28 14:58:33 devstack cinder-volume[86384]: INFO cinder.manager [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Service 3 cleanup completed. Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG cinder.service [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Creating RPC server for service cinder-volume {{(pid=86384) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG cinder.service [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86384) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:58:33 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:33 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:58:33 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:33 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:33 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-63691ce8-5371-421c-96f2-f2fd8a05f8af None None] Driver post RPC initialization completed successfully. Sep 28 14:58:41 devstack cinder-volume[86077]: DEBUG dbcounter [-] [86077] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:43 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:43 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:33 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 14:59:33 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:34 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.379s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 6 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:59:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Flow 'volume_create_manager' (33392a76-ad93-4a6e-926f-b3c13fb2fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324733a8-00c4-4b48-9134-87ed4bd66ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324733a8-00c4-4b48-9134-87ed4bd66ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1195624825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2246e3-352b-466f-b469-de6e76113583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68f4bd22f184f5399a1ecc3ef64f736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:40Z,use_quota=True,user_id='0ab514af29b440288f0affb34d79cd69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702416ca-21f7-4f28-89f4-d6f2b5bfb590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702416ca-21f7-4f28-89f4-d6f2b5bfb590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c3fd6a-1bb0-4d64-a890-eeac2c8610cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c3fd6a-1bb0-4d64-a890-eeac2c8610cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2246e3-352b-466f-b469-de6e76113583', 'volume_name': 'volume-3a2246e3-352b-466f-b469-de6e76113583', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d9909a-2bc9-4206-964f-c0b3b3f9988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d9909a-2bc9-4206-964f-c0b3b3f9988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837af47f-7f1b-482e-9cd0-85cad2f7c76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Volume 3a2246e3-352b-466f-b469-de6e76113583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2246e3-352b-466f-b469-de6e76113583', 'volume_size': 1} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1195624825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2246e3-352b-466f-b469-de6e76113583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68f4bd22f184f5399a1ecc3ef64f736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:40Z,use_quota=True,user_id='0ab514af29b440288f0affb34d79cd69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Creating volume 3a2246e3-352b-466f-b469-de6e76113583 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 14:59:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:39 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 1073741824 Sep 28 14:59:39 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:40 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 1073741824" returned: 0 in 0.680s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:40 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 Sep 28 14:59:40 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:41 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 14:59:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837af47f-7f1b-482e-9cd0-85cad2f7c76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2246e3-352b-466f-b469-de6e76113583', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e91adce-cffa-40ba-a842-d9371b77c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:41 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Volume volume-3a2246e3-352b-466f-b469-de6e76113583 (3a2246e3-352b-466f-b469-de6e76113583): created successfully Sep 28 14:59:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e91adce-cffa-40ba-a842-d9371b77c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Flow 'volume_create_manager' (33392a76-ad93-4a6e-926f-b3c13fb2fb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a685fdc9-904e-4023-89cd-b47abcb90307 tempest-TaggedAttachmentsTest-181148950 None] Created volume successfully. Sep 28 14:59:51 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:51 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Flow 'volume_create_manager' (4e655c62-8624-4150-9325-1196780aa117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7540d53-b2b5-4a9b-bcb7-c50d8c0e289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7540d53-b2b5-4a9b-bcb7-c50d8c0e289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-598819176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8569452-a3ee-4bb0-abd5-c10808d7c9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179931e79966450d81b64a3bfdc3ac1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:12Z,use_quota=True,user_id='79b22cafa1f04bba931da144dc9c5b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac0a13f-4f69-4a69-8254-6e398fbf7843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac0a13f-4f69-4a69-8254-6e398fbf7843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be47b39-e846-4043-9020-7b87a890ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be47b39-e846-4043-9020-7b87a890ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8569452-a3ee-4bb0-abd5-c10808d7c9e4', 'volume_name': 'volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3e9aee-d252-4290-b4da-5d3b56349724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3e9aee-d252-4290-b4da-5d3b56349724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dec9b1-4e85-4664-be28-b3463ebfcb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Volume c8569452-a3ee-4bb0-abd5-c10808d7c9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4', 'volume_size': 1} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-598819176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8569452-a3ee-4bb0-abd5-c10808d7c9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179931e79966450d81b64a3bfdc3ac1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:12Z,use_quota=True,user_id='79b22cafa1f04bba931da144dc9c5b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Creating volume c8569452-a3ee-4bb0-abd5-c10808d7c9e4 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:11 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:00:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:12 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 1073741824 Sep 28 15:00:12 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:13 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 1073741824" returned: 0 in 1.209s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:13 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 Sep 28 15:00:13 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:13 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4" returned: 0 in 0.601s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:00:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dec9b1-4e85-4664-be28-b3463ebfcb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e29678e-0043-4cd9-887a-108d245faf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Volume volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 (c8569452-a3ee-4bb0-abd5-c10808d7c9e4): created successfully Sep 28 15:00:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e29678e-0043-4cd9-887a-108d245faf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Flow 'volume_create_manager' (4e655c62-8624-4150-9325-1196780aa117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-844d7136-df2b-44c3-b1d5-9e357715400d tempest-VolumesAdminNegativeTest-741500894 None] Created volume successfully. Sep 28 15:00:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Acquiring lock "cinder-c8569452-a3ee-4bb0-abd5-c10808d7c9e4-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Lock "cinder-c8569452-a3ee-4bb0-abd5-c10808d7c9e4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Acquiring lock "cinder-quobyte-c8569452-a3ee-4bb0-abd5-c10808d7c9e4" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Lock "cinder-quobyte-c8569452-a3ee-4bb0-abd5-c10808d7c9e4" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:16 devstack cinder-volume[86384]: INFO oslo.privsep.daemon [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpizrcec5f/privsep.sock'] Sep 28 15:00:16 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpizrcec5f/privsep.sock Sep 28 15:00:16 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:00:19 devstack cinder-volume[86384]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 15:00:19 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:19 devstack cinder-volume[86384]: INFO oslo.privsep.daemon [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Spawned new privsep daemon via rootwrap Sep 28 15:00:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Accepted privsep connection to /tmp/tmpizrcec5f/privsep.sock {{(pid=86384) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 15:00:19 devstack cinder-volume[86384]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 15:00:19 devstack cinder-volume[86384]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 15:00:19 devstack cinder-volume[86384]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 15:00:19 devstack cinder-volume[86384]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87498 Sep 28 15:00:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014d60a-d010-4274-b0d9-05152539c607]: (2,) {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093d35a-5ec3-404c-bef9-ba7a3301cfdf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:20 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 Sep 28 15:00:20 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:21 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4" returned: 0 in 1.433s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:21 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4 Sep 28 15:00:21 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:22 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c8569452-a3ee-4bb0-abd5-c10808d7c9e4" returned: 0 in 0.793s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Lock "cinder-quobyte-c8569452-a3ee-4bb0-abd5-c10808d7c9e4" released by "delete_volume" :: held 5.976s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:22 devstack cinder-volume[86384]: WARNING cinder.quota [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:22 devstack cinder-volume[86384]: WARNING cinder.quota [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Created reservations ['4c7e4fa6-3f89-4bc5-aca5-6146c9d54cd4', '5bec73b8-1284-42b1-acc8-4affc7e34737', 'fccf160a-b2b0-4cf6-960c-2bfd0a8f3c11', '9cdb91f2-38f5-4294-8015-89bf16bdef9e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:22 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:00:22 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:23 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.825s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:23 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Deleted volume successfully. Sep 28 15:00:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff482ae-2bf3-4cfa-bfad-76dbfc65e746 tempest-VolumesAdminNegativeTest-741500894 None] Lock "cinder-c8569452-a3ee-4bb0-abd5-c10808d7c9e4-delete_volume" released by "delete_volume" :: held 7.707s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:32 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=12,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:33 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:00:33 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:34 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.370s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:40 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Flow 'volume_create_manager' (6bb192e1-4c48-4593-8d86-1c157c1b02ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053bf7c3-73ec-4634-b739-de69182b0818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053bf7c3-73ec-4634-b739-de69182b0818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-213504423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8c2e36-88bc-429a-9449-3887484c0b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1a5c3140b24cc8b319761e3db5e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:41Z,use_quota=True,user_id='713da8b5d588484a97343afd63ee72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c93f00e-d652-4984-85cf-87565b00aa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c93f00e-d652-4984-85cf-87565b00aa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ca6a16-b80c-46f8-85eb-626875401f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ca6a16-b80c-46f8-85eb-626875401f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8c2e36-88bc-429a-9449-3887484c0b5c', 'volume_name': 'volume-2d8c2e36-88bc-429a-9449-3887484c0b5c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65915a96-589d-4b99-9c8a-b8f2c17917cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65915a96-589d-4b99-9c8a-b8f2c17917cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ff6d6-0359-4b15-a83b-208be4c659c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:41 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Volume 2d8c2e36-88bc-429a-9449-3887484c0b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8c2e36-88bc-429a-9449-3887484c0b5c', 'volume_size': 1} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-213504423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8c2e36-88bc-429a-9449-3887484c0b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1a5c3140b24cc8b319761e3db5e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:41Z,use_quota=True,user_id='713da8b5d588484a97343afd63ee72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Creating volume 2d8c2e36-88bc-429a-9449-3887484c0b5c {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:41 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:41 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c 1073741824 Sep 28 15:00:41 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:41 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c 1073741824" returned: 0 in 0.697s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:41 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c Sep 28 15:00:41 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:42 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c" returned: 0 in 0.361s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:00:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ff6d6-0359-4b15-a83b-208be4c659c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8c2e36-88bc-429a-9449-3887484c0b5c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558f4e3c-c16e-43c0-be94-bb9286b16730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Volume volume-2d8c2e36-88bc-429a-9449-3887484c0b5c (2d8c2e36-88bc-429a-9449-3887484c0b5c): created successfully Sep 28 15:00:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558f4e3c-c16e-43c0-be94-bb9286b16730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Flow 'volume_create_manager' (6bb192e1-4c48-4593-8d86-1c157c1b02ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-95abb30a-8c33-4c82-84b0-d9608e726d47 tempest-AttachVolumeTestJSON-397034723 None] Created volume successfully. Sep 28 15:00:47 devstack cinder-volume[86384]: WARNING py.warnings [req-f8234712-7139-46c3-9603-0ffb32bd6aaa req-0cd25114-4d9f-4584-8d43-427f89c0ea43 tempest-AttachVolumeTestJSON-397034723 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 28 15:00:47 devstack cinder-volume[86384]: .first() Sep 28 15:00:47 devstack cinder-volume[86384]: Sep 28 15:00:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-f8234712-7139-46c3-9603-0ffb32bd6aaa req-0cd25114-4d9f-4584-8d43-427f89c0ea43 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-f8234712-7139-46c3-9603-0ffb32bd6aaa req-0cd25114-4d9f-4584-8d43-427f89c0ea43 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-f8234712-7139-46c3-9603-0ffb32bd6aaa req-0cd25114-4d9f-4584-8d43-427f89c0ea43 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-f8234712-7139-46c3-9603-0ffb32bd6aaa req-0cd25114-4d9f-4584-8d43-427f89c0ea43 tempest-AttachVolumeTestJSON-397034723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-2d8c2e36-88bc-429a-9449-3887484c0b5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9d016d9-29aa-40a4-9de4-2cf2a2d65041', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:00:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-f8234712-7139-46c3-9603-0ffb32bd6aaa req-0cd25114-4d9f-4584-8d43-427f89c0ea43 tempest-AttachVolumeTestJSON-397034723 None] attachment_update completed successfully. Sep 28 15:00:57 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:57 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-09836d6d-f05d-4ad1-a4f7-1c3010ea8036 req-103152c1-c4fa-49b6-8ec6-e905444ecbf2 tempest-TaggedAttachmentsTest-181148950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-09836d6d-f05d-4ad1-a4f7-1c3010ea8036 req-103152c1-c4fa-49b6-8ec6-e905444ecbf2 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-09836d6d-f05d-4ad1-a4f7-1c3010ea8036 req-103152c1-c4fa-49b6-8ec6-e905444ecbf2 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-09836d6d-f05d-4ad1-a4f7-1c3010ea8036 req-103152c1-c4fa-49b6-8ec6-e905444ecbf2 tempest-TaggedAttachmentsTest-181148950 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-3a2246e3-352b-466f-b469-de6e76113583', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48db71fa-daf0-4f56-aa0d-4a4a6c670edd', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:00:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-09836d6d-f05d-4ad1-a4f7-1c3010ea8036 req-103152c1-c4fa-49b6-8ec6-e905444ecbf2 tempest-TaggedAttachmentsTest-181148950 None] attachment_update completed successfully. Sep 28 15:01:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-c0975434-5b39-4785-837d-1fbaca8bc34c req-6799242c-e702-48bb-a26d-0804b2824100 tempest-TaggedAttachmentsTest-181148950 None] Terminate volume connection completed successfully. Sep 28 15:01:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-c0975434-5b39-4785-837d-1fbaca8bc34c req-6799242c-e702-48bb-a26d-0804b2824100 tempest-TaggedAttachmentsTest-181148950 None] Deleting attachment 48db71fa-daf0-4f56-aa0d-4a4a6c670edd. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Flow 'volume_create_manager' (0836365d-0e3c-476f-aee2-64edc664aade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a916a78f-0d95-461a-8a8c-0eacecbbcf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a916a78f-0d95-461a-8a8c-0eacecbbcf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-686388428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781a2d80-fbe3-4ee4-840c-3fac1e890e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7072343633784825bca9c006766aa403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:13Z,use_quota=True,user_id='22168e9298a04982bfce1fcf9ed70f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0296c2-b844-4edd-a485-654c27cbaae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0296c2-b844-4edd-a485-654c27cbaae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2244a81-bd88-4a7c-a44e-61cca1682e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2244a81-bd88-4a7c-a44e-61cca1682e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781a2d80-fbe3-4ee4-840c-3fac1e890e96', 'volume_name': 'volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d082403-ceed-468a-970d-42da8fc00327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d082403-ceed-468a-970d-42da8fc00327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f868921-9fe7-40a9-8926-15b94a49b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:13 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Volume 781a2d80-fbe3-4ee4-840c-3fac1e890e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96', 'volume_size': 1} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-686388428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781a2d80-fbe3-4ee4-840c-3fac1e890e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7072343633784825bca9c006766aa403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:13Z,use_quota=True,user_id='22168e9298a04982bfce1fcf9ed70f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Creating volume 781a2d80-fbe3-4ee4-840c-3fac1e890e96 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:13 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:01:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:13 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 1073741824 Sep 28 15:01:13 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:14 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 1073741824" returned: 0 in 1.086s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:14 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 Sep 28 15:01:14 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:15 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96" returned: 0 in 0.794s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f868921-9fe7-40a9-8926-15b94a49b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3cbe1b-63dd-4dfe-bc48-88841def9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:15 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Volume volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 (781a2d80-fbe3-4ee4-840c-3fac1e890e96): created successfully Sep 28 15:01:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3cbe1b-63dd-4dfe-bc48-88841def9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Flow 'volume_create_manager' (0836365d-0e3c-476f-aee2-64edc664aade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d9940470-37a9-44b7-a314-d7ebaa48a1a5 tempest-DeleteServersTestJSON-1451953559 None] Created volume successfully. Sep 28 15:01:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-d3ea07ca-e92f-4487-91ba-7122f82d8fbf req-002d9b91-08c5-4254-850c-ecb06208802c tempest-DeleteServersTestJSON-1451953559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-d3ea07ca-e92f-4487-91ba-7122f82d8fbf req-002d9b91-08c5-4254-850c-ecb06208802c tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-d3ea07ca-e92f-4487-91ba-7122f82d8fbf req-002d9b91-08c5-4254-850c-ecb06208802c tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-d3ea07ca-e92f-4487-91ba-7122f82d8fbf req-002d9b91-08c5-4254-850c-ecb06208802c tempest-DeleteServersTestJSON-1451953559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45248eb0-c96e-4c96-b310-524ce48bb2e9', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:01:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-d3ea07ca-e92f-4487-91ba-7122f82d8fbf req-002d9b91-08c5-4254-850c-ecb06208802c tempest-DeleteServersTestJSON-1451953559 None] attachment_update completed successfully. Sep 28 15:01:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-1e4ff9fb-ef20-40c5-bd88-002dc393f989 req-f05170a3-9c41-4a87-8149-256dfc9a9b35 tempest-DeleteServersTestJSON-1451953559 None] Terminate volume connection completed successfully. Sep 28 15:01:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-1e4ff9fb-ef20-40c5-bd88-002dc393f989 req-f05170a3-9c41-4a87-8149-256dfc9a9b35 tempest-DeleteServersTestJSON-1451953559 None] Deleting attachment 45248eb0-c96e-4c96-b310-524ce48bb2e9. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:01:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Acquiring lock "cinder-781a2d80-fbe3-4ee4-840c-3fac1e890e96-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Lock "cinder-781a2d80-fbe3-4ee4-840c-3fac1e890e96-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Acquiring lock "cinder-quobyte-781a2d80-fbe3-4ee4-840c-3fac1e890e96" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Lock "cinder-quobyte-781a2d80-fbe3-4ee4-840c-3fac1e890e96" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a5044-6372-4bce-b362-41705f32d87e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:27 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 Sep 28 15:01:27 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:27 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96" returned: 0 in 0.805s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:27 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96 Sep 28 15:01:27 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:28 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-781a2d80-fbe3-4ee4-840c-3fac1e890e96" returned: 0 in 0.494s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Lock "cinder-quobyte-781a2d80-fbe3-4ee4-840c-3fac1e890e96" released by "delete_volume" :: held 1.378s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Created reservations ['89f09ad1-508e-4b00-9544-a08f5cc6ec15', 'e0cdb41b-8822-4eeb-a4f1-454a42efb72a', 'a5b54bef-680f-40d1-b5e7-e69cc298666b', 'a4b24f60-2f82-4524-a1c9-71aaf46bd155'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:28 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:01:28 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:29 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.663s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Deleted volume successfully. Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1bc450ee-a8a4-45cf-8047-71994bc32286 tempest-DeleteServersTestJSON-1451953559 None] Lock "cinder-781a2d80-fbe3-4ee4-840c-3fac1e890e96-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Acquiring lock "cinder-3a2246e3-352b-466f-b469-de6e76113583-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Lock "cinder-3a2246e3-352b-466f-b469-de6e76113583-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Acquiring lock "cinder-quobyte-3a2246e3-352b-466f-b469-de6e76113583" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Lock "cinder-quobyte-3a2246e3-352b-466f-b469-de6e76113583" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16a96f1-485b-40c3-abd8-27c69b5247e1]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:29 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 Sep 28 15:01:29 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-faffad4c-c743-42f3-9ccf-480bba62b3d5 req-c7a462f1-7987-44e8-8871-6197ea3a8acf tempest-AttachVolumeTestJSON-397034723 None] Terminate volume connection completed successfully. Sep 28 15:01:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-faffad4c-c743-42f3-9ccf-480bba62b3d5 req-c7a462f1-7987-44e8-8871-6197ea3a8acf tempest-AttachVolumeTestJSON-397034723 None] Deleting attachment f9d016d9-29aa-40a4-9de4-2cf2a2d65041. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:01:30 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583" returned: 0 in 0.721s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:30 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583 Sep 28 15:01:30 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:30 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a2246e3-352b-466f-b469-de6e76113583" returned: 0 in 0.502s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Lock "cinder-quobyte-3a2246e3-352b-466f-b469-de6e76113583" released by "delete_volume" :: held 1.315s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Created reservations ['2f68b9eb-dc7a-4747-bd9d-b8fab44cb3f3', 'dca70226-4924-4572-8911-12323ad9579a', '9399dddf-0828-498e-8bc4-f1ae109bfe10', '0e1bfc39-5287-4d34-8dbc-76555bad053c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:31 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:01:31 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:31 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.343s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:31 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Deleted volume successfully. Sep 28 15:01:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a90ee40d-d88c-4140-8d65-cd25783616d6 tempest-TaggedAttachmentsTest-181148950 None] Lock "cinder-3a2246e3-352b-466f-b469-de6e76113583-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:01:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:33 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:01:33 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:34 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.302s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:01:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 8 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:01:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:01:40 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=29,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:41 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=27,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Flow 'volume_create_manager' (dedb6ea9-0be9-4335-924d-ae36e75b78be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea86cc0c-568a-4089-a2d8-7e5b22d426b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea86cc0c-568a-4089-a2d8-7e5b22d426b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1623159489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f991e124-2ed1-4ae9-ac8c-3025dfaba823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d3120d09534f5d9fe99efd1f605cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:09Z,use_quota=True,user_id='195257f1dfa94a458154cc4aaa95b75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdccede-26ca-4b57-ba94-5f6cad534c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdccede-26ca-4b57-ba94-5f6cad534c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d4077a-148a-4c39-98ce-414d0eb8697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d4077a-148a-4c39-98ce-414d0eb8697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f991e124-2ed1-4ae9-ac8c-3025dfaba823', 'volume_name': 'volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5927ca8-7d97-4414-9eb9-7b0d48768bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5927ca8-7d97-4414-9eb9-7b0d48768bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cb2328-0d8d-4050-8d08-3a59894aa0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Volume f991e124-2ed1-4ae9-ac8c-3025dfaba823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823', 'volume_size': 1} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1623159489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f991e124-2ed1-4ae9-ac8c-3025dfaba823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d3120d09534f5d9fe99efd1f605cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:09Z,use_quota=True,user_id='195257f1dfa94a458154cc4aaa95b75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Creating volume f991e124-2ed1-4ae9-ac8c-3025dfaba823 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:08 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:02:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 1073741824 Sep 28 15:02:08 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:09 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 1073741824" returned: 0 in 0.778s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:09 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 Sep 28 15:02:09 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823" returned: 0 in 0.339s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cb2328-0d8d-4050-8d08-3a59894aa0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437a75be-8ef7-4e74-ba31-043ab704f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:10 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Volume volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 (f991e124-2ed1-4ae9-ac8c-3025dfaba823): created successfully Sep 28 15:02:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437a75be-8ef7-4e74-ba31-043ab704f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Flow 'volume_create_manager' (dedb6ea9-0be9-4335-924d-ae36e75b78be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0a082e09-025b-4ec0-a6f4-62bcd3074b7d tempest-ServerActionsTestOtherA-1857447018 None] Created volume successfully. Sep 28 15:02:20 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:20 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:33 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:02:33 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:35 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 1.241s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:35 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:35 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 8 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:02:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:02:43 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Flow 'volume_create_manager' (9aafbcb0-6684-4ead-93d5-facfcc1bd510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77178511-00ba-4612-9343-ce3d46f38c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77178511-00ba-4612-9343-ce3d46f38c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1201891439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7d343d-cd4e-4f2d-84ef-0b7556e794a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552db855014c489f86f7b933bea83215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:58Z,use_quota=True,user_id='15ef1c60fa27484baf8d254e2435240a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ada578-0f18-4202-97ad-9d1889f3ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ada578-0f18-4202-97ad-9d1889f3ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3faa5e-6652-41d1-922e-8bf852ba6d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3faa5e-6652-41d1-922e-8bf852ba6d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7d343d-cd4e-4f2d-84ef-0b7556e794a7', 'volume_name': 'volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e025ac6e-91bf-48ee-a6a3-73dca67e0216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e025ac6e-91bf-48ee-a6a3-73dca67e0216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d6a805-fcbb-4036-a3f1-2b9615aaf9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Volume cf7d343d-cd4e-4f2d-84ef-0b7556e794a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7', 'volume_size': 1} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1201891439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7d343d-cd4e-4f2d-84ef-0b7556e794a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552db855014c489f86f7b933bea83215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:58Z,use_quota=True,user_id='15ef1c60fa27484baf8d254e2435240a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Creating volume cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:58 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:02:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:59 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 1073741824 Sep 28 15:02:59 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:00 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 1073741824" returned: 0 in 1.900s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:00 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 Sep 28 15:03:00 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:01 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7" returned: 0 in 0.526s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] <== create_volume: return (2669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d6a805-fcbb-4036-a3f1-2b9615aaf9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5617ec0-d772-4f29-a2b9-b725fdae0f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Volume volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 (cf7d343d-cd4e-4f2d-84ef-0b7556e794a7): created successfully Sep 28 15:03:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5617ec0-d772-4f29-a2b9-b725fdae0f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Flow 'volume_create_manager' (9aafbcb0-6684-4ead-93d5-facfcc1bd510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-829d8f7b-9916-4598-a27b-dee78b95b197 tempest-ServerRescueNegativeTestJSON-151635833 None] Created volume successfully. Sep 28 15:03:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Flow 'volume_create_manager' (1e7f4e7d-f328-4aa9-9a7e-a49316b5542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdd7858-ac14-4529-8cb8-fdee0ef4823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdd7858-ac14-4529-8cb8-fdee0ef4823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1921009493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4545a34-5cb1-425b-a7e6-494c333037e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea494785d664f909565206d494df8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:03Z,use_quota=True,user_id='2880642ea65242f5aa6580bb821e832c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746a8a36-a980-4b79-8e2d-bbc21d8360e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746a8a36-a980-4b79-8e2d-bbc21d8360e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cae5253-0642-41fd-a765-a61d96f0826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cae5253-0642-41fd-a765-a61d96f0826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4545a34-5cb1-425b-a7e6-494c333037e9', 'volume_name': 'volume-a4545a34-5cb1-425b-a7e6-494c333037e9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb40dda-fb46-4768-bd90-fba6f43d033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb40dda-fb46-4768-bd90-fba6f43d033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0938d4a-af63-4638-b288-7f43535f722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Volume a4545a34-5cb1-425b-a7e6-494c333037e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4545a34-5cb1-425b-a7e6-494c333037e9', 'volume_size': 1} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1921009493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4545a34-5cb1-425b-a7e6-494c333037e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea494785d664f909565206d494df8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:03Z,use_quota=True,user_id='2880642ea65242f5aa6580bb821e832c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Creating volume a4545a34-5cb1-425b-a7e6-494c333037e9 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:03 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:03:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:03 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 1073741824 Sep 28 15:03:03 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:04 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 1073741824" returned: 0 in 1.088s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:04 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 Sep 28 15:03:04 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:04 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9" returned: 0 in 0.535s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0938d4a-af63-4638-b288-7f43535f722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4545a34-5cb1-425b-a7e6-494c333037e9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2353af-1c2a-4cad-8f67-9499803bbe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Volume volume-a4545a34-5cb1-425b-a7e6-494c333037e9 (a4545a34-5cb1-425b-a7e6-494c333037e9): created successfully Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2353af-1c2a-4cad-8f67-9499803bbe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Flow 'volume_create_manager' (1e7f4e7d-f328-4aa9-9a7e-a49316b5542d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-31a20646-7f75-4f9d-ab98-37720ebe99bc tempest-ServersNegativeTestJSON-1948377280 None] Created volume successfully. Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Flow 'volume_create_manager' (05cf6f3d-4449-4944-819e-90d1037e6270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcb1b7a-02e8-47b9-a2a0-64ecf37c4af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcb1b7a-02e8-47b9-a2a0-64ecf37c4af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1874195060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe44f5fc-3a8c-43a6-b06b-c5f5c828de08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea494785d664f909565206d494df8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:08Z,use_quota=True,user_id='2880642ea65242f5aa6580bb821e832c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f39d55-fce0-42bd-94ee-15cd3de3c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f39d55-fce0-42bd-94ee-15cd3de3c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7e60c4-c438-4b30-88b0-5609be132341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7e60c4-c438-4b30-88b0-5609be132341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe44f5fc-3a8c-43a6-b06b-c5f5c828de08', 'volume_name': 'volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37fb0a1-e53d-4d9b-b189-dbbd1f0f6a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37fb0a1-e53d-4d9b-b189-dbbd1f0f6a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd12eefb-02dc-4ca6-b417-e3e197e7db5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Volume fe44f5fc-3a8c-43a6-b06b-c5f5c828de08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08', 'volume_size': 1} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1874195060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe44f5fc-3a8c-43a6-b06b-c5f5c828de08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea494785d664f909565206d494df8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:08Z,use_quota=True,user_id='2880642ea65242f5aa6580bb821e832c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Creating volume fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:08 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:03:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:08 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 1073741824 Sep 28 15:03:08 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:09 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 1073741824" returned: 0 in 0.727s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:09 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 Sep 28 15:03:09 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:09 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08" returned: 0 in 0.317s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd12eefb-02dc-4ca6-b417-e3e197e7db5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2dd461-d2c0-481b-94f4-d0deece1a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:09 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Volume volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 (fe44f5fc-3a8c-43a6-b06b-c5f5c828de08): created successfully Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2dd461-d2c0-481b-94f4-d0deece1a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Flow 'volume_create_manager' (05cf6f3d-4449-4944-819e-90d1037e6270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a6501f47-cc02-4f6a-8f27-f02f4a864dcf tempest-ServersNegativeTestJSON-1948377280 None] Created volume successfully. Sep 28 15:03:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "cinder-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "cinder-quobyte-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-quobyte-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08" acquired by "delete_volume" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:11 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54dcf7c-951f-41d5-a2f0-1b9ead9dfc41]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:12 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 Sep 28 15:03:12 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:12 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08" returned: 0 in 1.102s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:12 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08 Sep 28 15:03:12 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:13 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08" returned: 0 in 0.476s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-quobyte-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08" released by "delete_volume" :: held 1.694s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Created reservations ['7a493414-26cb-4ede-aa17-68b84f5bdce4', '6d7fe67f-6250-425b-a559-c596b9b23232', '3371a87b-39c4-4b3f-a57c-c83bdc115b6a', '2502c3a7-333c-4e7d-9370-526b21c8d6dc'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:13 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:03:13 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "cinder-a4545a34-5cb1-425b-a7e6-494c333037e9-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-a4545a34-5cb1-425b-a7e6-494c333037e9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "cinder-quobyte-a4545a34-5cb1-425b-a7e6-494c333037e9" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-quobyte-a4545a34-5cb1-425b-a7e6-494c333037e9" acquired by "delete_volume" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e967a-36a0-4c51-8de4-0bc163df0eba]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:14 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 Sep 28 15:03:14 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:14 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.883s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Deleted volume successfully. Sep 28 15:03:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cb032aca-c299-4a1b-b1d5-76b444f8c54e tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-fe44f5fc-3a8c-43a6-b06b-c5f5c828de08-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:15 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9" returned: 0 in 1.157s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:15 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9 Sep 28 15:03:15 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:15 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a4545a34-5cb1-425b-a7e6-494c333037e9" returned: 0 in 0.713s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-quobyte-a4545a34-5cb1-425b-a7e6-494c333037e9" released by "delete_volume" :: held 1.949s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Created reservations ['86941c22-1c57-4ba9-a727-c4bdb70508b5', '62179dd9-dade-4ae9-87a7-e928af7e9218', 'edf19951-8a64-4c4a-a676-b10cb1da88f6', '1f3eeedb-6264-416b-bd21-01b7a39866c1'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:16 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:03:16 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:16 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.417s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Deleted volume successfully. Sep 28 15:03:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-622130df-6397-430e-9839-6145c48ce7d4 tempest-ServersNegativeTestJSON-1948377280 None] Lock "cinder-a4545a34-5cb1-425b-a7e6-494c333037e9-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Acquiring lock "cinder-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-7433e9ee-d828-46e9-a2e0-96b697468738 req-93c3175a-b3b3-4d73-a724-90720ab10dbf tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-7433e9ee-d828-46e9-a2e0-96b697468738 req-93c3175a-b3b3-4d73-a724-90720ab10dbf tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "cinder-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-7433e9ee-d828-46e9-a2e0-96b697468738 req-93c3175a-b3b3-4d73-a724-90720ab10dbf tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Acquiring lock "cinder-quobyte-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-7433e9ee-d828-46e9-a2e0-96b697468738 req-93c3175a-b3b3-4d73-a724-90720ab10dbf tempest-ServerActionsTestOtherA-1857447018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fa87045-5c7e-48b0-bbe4-d292e4e4b6ab', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "cinder-quobyte-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7" acquired by "delete_volume" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[296558a6-9fa8-413c-8717-9a82f9ca90cf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-7433e9ee-d828-46e9-a2e0-96b697468738 req-93c3175a-b3b3-4d73-a724-90720ab10dbf tempest-ServerActionsTestOtherA-1857447018 None] attachment_update completed successfully. Sep 28 15:03:18 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 Sep 28 15:03:18 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:18 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7" returned: 0 in 1.194s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:18 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7 Sep 28 15:03:19 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:19 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7" returned: 0 in 0.793s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "cinder-quobyte-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7" released by "delete_volume" :: held 2.222s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:19 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Created reservations ['cf2cbebb-d508-4d10-9dd1-b5ca74356053', '65da27b2-0be1-4a05-bc10-621bb3ec5869', '13b23e85-8c70-4e31-a171-eba84809f1b2', '42ac434c-46a8-4331-ab9b-9d3138ce24ef'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:20 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:03:20 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:20 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.615s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Deleted volume successfully. Sep 28 15:03:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a3fab89-9908-4d4e-9248-0f80476e152a tempest-ServerRescueNegativeTestJSON-151635833 None] Lock "cinder-cf7d343d-cd4e-4f2d-84ef-0b7556e794a7-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-0eb20236-83da-45a9-9c0d-5cb43d84edd7 req-527e6047-992d-4760-bb80-8e64d2da3bd1 tempest-ServerActionsTestOtherA-1857447018 None] Terminate volume connection completed successfully. Sep 28 15:03:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-0eb20236-83da-45a9-9c0d-5cb43d84edd7 req-527e6047-992d-4760-bb80-8e64d2da3bd1 tempest-ServerActionsTestOtherA-1857447018 None] Deleting attachment 0fa87045-5c7e-48b0-bbe4-d292e4e4b6ab. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:03:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-0eb20236-83da-45a9-9c0d-5cb43d84edd7 req-a770fffe-433e-4ec9-aceb-3a1eb1794b0b tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-0eb20236-83da-45a9-9c0d-5cb43d84edd7 req-a770fffe-433e-4ec9-aceb-3a1eb1794b0b tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-0eb20236-83da-45a9-9c0d-5cb43d84edd7 req-a770fffe-433e-4ec9-aceb-3a1eb1794b0b tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-0eb20236-83da-45a9-9c0d-5cb43d84edd7 req-a770fffe-433e-4ec9-aceb-3a1eb1794b0b tempest-ServerActionsTestOtherA-1857447018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '175c1812-37b2-4267-ace6-75e67ba74a82', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:26 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-0eb20236-83da-45a9-9c0d-5cb43d84edd7 req-a770fffe-433e-4ec9-aceb-3a1eb1794b0b tempest-ServerActionsTestOtherA-1857447018 None] attachment_update completed successfully. Sep 28 15:03:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:33 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:03:33 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:34 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.553s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 8 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:03:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:03:36 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=39,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:36 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=36,cinder:SELECT=31,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Flow 'volume_create_manager' (787f46dd-b43b-4e72-8727-0438cf42eb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12155b5-8156-476f-be5e-a300ed303209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12155b5-8156-476f-be5e-a300ed303209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-634397207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f0a78d-8dc0-464e-ba87-32b70faba82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753f8647fad5483db7d5d40e030e9e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:40Z,use_quota=True,user_id='4e24ea5358bc4a3f88bceb23bd759da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e7f261-0fdb-4cba-a712-5a5ab4055090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e7f261-0fdb-4cba-a712-5a5ab4055090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f038c3ba-baeb-4653-a181-2fdbbae11cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f038c3ba-baeb-4653-a181-2fdbbae11cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f0a78d-8dc0-464e-ba87-32b70faba82c', 'volume_name': 'volume-58f0a78d-8dc0-464e-ba87-32b70faba82c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501b651d-409b-4a8f-b5ef-4c2a30d0d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501b651d-409b-4a8f-b5ef-4c2a30d0d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59cdc9d-4a21-45e9-b1ac-5623f2e54907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Volume 58f0a78d-8dc0-464e-ba87-32b70faba82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f0a78d-8dc0-464e-ba87-32b70faba82c', 'volume_size': 1} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-634397207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f0a78d-8dc0-464e-ba87-32b70faba82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753f8647fad5483db7d5d40e030e9e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:40Z,use_quota=True,user_id='4e24ea5358bc4a3f88bceb23bd759da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Creating volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:03:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:39 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c 1073741824 Sep 28 15:03:39 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c 1073741824" returned: 0 in 0.493s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c Sep 28 15:03:40 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c" returned: 0 in 0.301s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59cdc9d-4a21-45e9-b1ac-5623f2e54907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f0a78d-8dc0-464e-ba87-32b70faba82c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7d5b47-82b3-43c0-a34d-ec08fa0e2418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:40 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Volume volume-58f0a78d-8dc0-464e-ba87-32b70faba82c (58f0a78d-8dc0-464e-ba87-32b70faba82c): created successfully Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7d5b47-82b3-43c0-a34d-ec08fa0e2418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Flow 'volume_create_manager' (787f46dd-b43b-4e72-8727-0438cf42eb35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:40 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8ee9b1ce-98e8-4a3b-8a7b-a3903ba7f066 tempest-SnapshotsActionsTest-1490931929 None] Created volume successfully. Sep 28 15:03:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Creating offline snapshot 54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:42 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d7bb42-dfc1-4166-a5ce-19cc861b72ed]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c Sep 28 15:03:42 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:42 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c" returned: 0 in 0.484s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 1G Sep 28 15:03:42 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 1G" returned: 0 in 0.572s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:03:43 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 is being set with open permissions: ugo+rw Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:03:43 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Flow 'volume_create_manager' (c5e19c8a-f895-4277-a8b5-34bf8d77dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4841e687-65ba-4f71-ab26-2251e918ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4841e687-65ba-4f71-ab26-2251e918ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382717420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4a50c9-3b57-4808-91cc-428d78b4a79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1a5c3140b24cc8b319761e3db5e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:44Z,use_quota=True,user_id='713da8b5d588484a97343afd63ee72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9570be8-c213-4cb3-a786-ff05901fa18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9570be8-c213-4cb3-a786-ff05901fa18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5a0fb6-28ee-459f-973e-0822b0e112bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5a0fb6-28ee-459f-973e-0822b0e112bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4a50c9-3b57-4808-91cc-428d78b4a79a', 'volume_name': 'volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283fb88e-dbcd-4279-98da-35781dbe502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283fb88e-dbcd-4279-98da-35781dbe502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb8461f-b92b-44c0-9b8a-2344070bbc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:44 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Volume bc4a50c9-3b57-4808-91cc-428d78b4a79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a', 'volume_size': 1} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:44 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.425s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.info Sep 28 15:03:44 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.info" returned: 0 in 0.429s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.info is being set with open permissions: ugo+rw Sep 28 15:03:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.info Sep 28 15:03:44 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:45 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.info" returned: 0 in 0.296s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382717420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4a50c9-3b57-4808-91cc-428d78b4a79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1a5c3140b24cc8b319761e3db5e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:44Z,use_quota=True,user_id='713da8b5d588484a97343afd63ee72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Creating volume bc4a50c9-3b57-4808-91cc-428d78b4a79a {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:45 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:45 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a 1073741824 Sep 28 15:03:45 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9ebca4cc-a166-4634-a1c3-20ace262e5ed tempest-SnapshotsActionsTest-1490931929 None] Create snapshot completed successfully Sep 28 15:03:45 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a 1073741824" returned: 0 in 0.678s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:45 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a Sep 28 15:03:45 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:46 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a" returned: 0 in 0.373s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb8461f-b92b-44c0-9b8a-2344070bbc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab11974-1add-415f-9cfb-2926ace5ba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:46 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Volume volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a (bc4a50c9-3b57-4808-91cc-428d78b4a79a): created successfully Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab11974-1add-415f-9cfb-2926ace5ba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Flow 'volume_create_manager' (c5e19c8a-f895-4277-a8b5-34bf8d77dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:46 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f9820816-6bb4-4c17-896e-d400d4ad193c tempest-AttachVolumeTestJSON-397034723 None] Created volume successfully. Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Creating offline snapshot 44452745-2f53-42a2-8dbc-c990038db35b of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0285685a-1d51-43f1-8039-b507a4c42899]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:46 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:03:46 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:47 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.483s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:47 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b 1G Sep 28 15:03:47 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b 1G" returned: 0 in 0.889s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:48 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b Sep 28 15:03:48 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-8c9e53db-8132-4749-90a8-6dd977751708 req-c8e1409f-5c66-4275-ac60-c5d762e09ba2 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:48 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b" returned: 0 in 0.471s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b is being set with open permissions: ugo+rw Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:48 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b Sep 28 15:03:48 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b" returned: 0 in 0.301s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-8c9e53db-8132-4749-90a8-6dd977751708 req-c8e1409f-5c66-4275-ac60-c5d762e09ba2 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.553s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-8c9e53db-8132-4749-90a8-6dd977751708 req-c8e1409f-5c66-4275-ac60-c5d762e09ba2 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:48 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f5a3c474-4274-49a0-8ffb-325685429db5 tempest-SnapshotsActionsTest-1490931929 None] Create snapshot completed successfully Sep 28 15:03:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-8c9e53db-8132-4749-90a8-6dd977751708 req-c8e1409f-5c66-4275-ac60-c5d762e09ba2 tempest-AttachVolumeTestJSON-397034723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6af175f-5186-4bed-961a-b18b552d6429', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-8c9e53db-8132-4749-90a8-6dd977751708 req-c8e1409f-5c66-4275-ac60-c5d762e09ba2 tempest-AttachVolumeTestJSON-397034723 None] attachment_update completed successfully. Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-44452745-2f53-42a2-8dbc-c990038db35b-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-44452745-2f53-42a2-8dbc-c990038db35b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-44452745-2f53-42a2-8dbc-c990038db35b" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-44452745-2f53-42a2-8dbc-c990038db35b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Deleting offline snapshot 44452745-2f53-42a2-8dbc-c990038db35b of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] snapshot_file for this snap is: volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6f4af0-ed7c-4fcb-8e87-f0217e43d07b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:50 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b Sep 28 15:03:50 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:50 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b" returned: 0 in 0.566s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a922d68d-44e5-4b4a-ae56-09a35e9d9e85]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:51 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:03:51 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Flow 'volume_create_manager' (73d14301-cd47-4180-8014-7bfc5dbc9122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88f0d58-e019-458f-b4a4-a1334e294528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88f0d58-e019-458f-b4a4-a1334e294528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-991217861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e5b4e4-5b6d-4248-a073-e468af10c83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1a5c3140b24cc8b319761e3db5e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:51Z,use_quota=True,user_id='713da8b5d588484a97343afd63ee72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2a677d-aa6a-4dc8-b2b3-05dba17a4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2a677d-aa6a-4dc8-b2b3-05dba17a4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4028902-7ccd-475b-a085-4d77e5271eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4028902-7ccd-475b-a085-4d77e5271eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e5b4e4-5b6d-4248-a073-e468af10c83d', 'volume_name': 'volume-63e5b4e4-5b6d-4248-a073-e468af10c83d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b6e18-717e-4c11-b865-258b0c7ae4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b6e18-717e-4c11-b865-258b0c7ae4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ea1b8d-ff9a-4581-9016-86c0d6663bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:51 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Volume 63e5b4e4-5b6d-4248-a073-e468af10c83d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e5b4e4-5b6d-4248-a073-e468af10c83d', 'volume_size': 1} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-991217861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e5b4e4-5b6d-4248-a073-e468af10c83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1a5c3140b24cc8b319761e3db5e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:51Z,use_quota=True,user_id='713da8b5d588484a97343afd63ee72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Creating volume 63e5b4e4-5b6d-4248-a073-e468af10c83d {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:51 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:51 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d 1073741824 Sep 28 15:03:51 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:51 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.567s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:51 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b Sep 28 15:03:51 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:52 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d 1073741824" returned: 0 in 0.769s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:52 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b" returned: 0 in 0.658s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:52 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b Sep 28 15:03:52 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:52 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d Sep 28 15:03:52 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:52 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.44452745-2f53-42a2-8dbc-c990038db35b" returned: 0 in 0.423s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-44452745-2f53-42a2-8dbc-c990038db35b" released by "_delete_snapshot" :: held 2.390s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" released by "delete_snapshot" :: held 2.429s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:52 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d" returned: 0 in 0.526s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:52 devstack cinder-volume[86384]: WARNING cinder.quota [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ea1b8d-ff9a-4581-9016-86c0d6663bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e5b4e4-5b6d-4248-a073-e468af10c83d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077a27a8-1aaf-4019-a5e5-5a339b919903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Created reservations ['d45a705f-8848-4232-abbe-e2609a038dbe', 'a88b40a8-83ad-4dc4-aa06-e6f3710696ca', 'faf1d5bb-7752-4885-b6ce-10014e481771', '8217b90f-ccfb-4f9f-8bb2-2dff06757dbe'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:52 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Volume volume-63e5b4e4-5b6d-4248-a073-e468af10c83d (63e5b4e4-5b6d-4248-a073-e468af10c83d): created successfully Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077a27a8-1aaf-4019-a5e5-5a339b919903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Flow 'volume_create_manager' (73d14301-cd47-4180-8014-7bfc5dbc9122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4839e13d-478c-42a8-8d57-8924f3299100 tempest-AttachVolumeTestJSON-397034723 None] Created volume successfully. Sep 28 15:03:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Delete snapshot completed successfully. Sep 28 15:03:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6822b676-8f7a-4b73-bf6e-00126b034f09 tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-44452745-2f53-42a2-8dbc-c990038db35b-delete_snapshot" released by "delete_snapshot" :: held 2.796s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Creating offline snapshot 212f0329-db1b-4868-b89f-37369826e566 of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2072d2d5-6bcb-4aa4-ba62-e21e22c78280]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:54 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:03:54 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-1d26b54c-5576-44dc-b269-7eedf90117ba req-4e51ff4e-9da5-4b06-a667-995a04ce687c tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:54 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.682s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:54 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 1G Sep 28 15:03:54 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:55 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 1G" returned: 0 in 0.774s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:55 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 Sep 28 15:03:55 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-4fd1490c-e443-4a8e-9bce-90505050221b req-602c82ca-48f4-4ac6-8dd9-93840cef9bc9 tempest-ServerActionsTestOtherA-1857447018 None] Terminate volume connection completed successfully. Sep 28 15:03:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-4fd1490c-e443-4a8e-9bce-90505050221b req-602c82ca-48f4-4ac6-8dd9-93840cef9bc9 tempest-ServerActionsTestOtherA-1857447018 None] Deleting attachment 175c1812-37b2-4267-ace6-75e67ba74a82. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:03:56 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566" returned: 0 in 0.377s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:56 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 is being set with open permissions: ugo+rw Sep 28 15:03:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:56 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 Sep 28 15:03:56 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:56 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-1d26b54c-5576-44dc-b269-7eedf90117ba req-4e51ff4e-9da5-4b06-a667-995a04ce687c tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.092s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-1d26b54c-5576-44dc-b269-7eedf90117ba req-4e51ff4e-9da5-4b06-a667-995a04ce687c tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d868b5e8-f0c9-4fe2-ac1f-8f0a1509e890 tempest-SnapshotsActionsTest-1490931929 None] Create snapshot completed successfully Sep 28 15:03:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-1d26b54c-5576-44dc-b269-7eedf90117ba req-4e51ff4e-9da5-4b06-a667-995a04ce687c tempest-AttachVolumeTestJSON-397034723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-63e5b4e4-5b6d-4248-a073-e468af10c83d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96d02fc8-bea3-4b73-9ef7-180a31c5a950', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-1d26b54c-5576-44dc-b269-7eedf90117ba req-4e51ff4e-9da5-4b06-a667-995a04ce687c tempest-AttachVolumeTestJSON-397034723 None] attachment_update completed successfully. Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-212f0329-db1b-4868-b89f-37369826e566-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-212f0329-db1b-4868-b89f-37369826e566-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-212f0329-db1b-4868-b89f-37369826e566" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-212f0329-db1b-4868-b89f-37369826e566" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Deleting offline snapshot 212f0329-db1b-4868-b89f-37369826e566 of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] snapshot_file for this snap is: volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae531c0-bc8f-4688-81d2-11bc3657e4b3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:58 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 Sep 28 15:03:58 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:58 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566" returned: 0 in 0.595s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7c98f-b3ac-40da-9ed7-054158b3cc5b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:58 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:03:58 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:59 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.657s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:59 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 Sep 28 15:03:59 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:59 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566" returned: 0 in 0.703s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:59 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566 Sep 28 15:03:59 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-2e852472-5dbb-40a1-8008-f411dec7de15 req-2dd77f79-21f8-41f4-bded-1a19256dcffd tempest-AttachVolumeTestJSON-397034723 None] Terminate volume connection completed successfully. Sep 28 15:04:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-2e852472-5dbb-40a1-8008-f411dec7de15 req-2dd77f79-21f8-41f4-bded-1a19256dcffd tempest-AttachVolumeTestJSON-397034723 None] Deleting attachment d6af175f-5186-4bed-961a-b18b552d6429. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:00 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.212f0329-db1b-4868-b89f-37369826e566" returned: 0 in 0.497s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-212f0329-db1b-4868-b89f-37369826e566" released by "_delete_snapshot" :: held 2.685s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" released by "delete_snapshot" :: held 2.737s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:00 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Created reservations ['974b948b-67a5-4ecc-bdcd-fa18c17b2c8a', 'd43a10d0-3bb8-4a57-b325-1595ad867058', '131b8d59-7908-4eb7-8160-76ffdf52bdaa', '102a91b4-ee94-4bea-a351-64b80acb7f4b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Delete snapshot completed successfully. Sep 28 15:04:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a7db188b-e437-44a9-8f94-a609f2a74bee tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-212f0329-db1b-4868-b89f-37369826e566-delete_snapshot" released by "delete_snapshot" :: held 2.970s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Creating offline snapshot 980f0cae-05c5-4aab-a3f7-a4423285c7c6 of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:04:01 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31b31c7-862d-4284-9e8b-198f10322af5]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:04:01 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-f9e039bb-347d-4d58-a825-4f20a2f8c642 req-04e3c458-473d-4dcc-8313-63a5cf8266c8 tempest-AttachVolumeTestJSON-397034723 None] Terminate volume connection completed successfully. Sep 28 15:04:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-f9e039bb-347d-4d58-a825-4f20a2f8c642 req-04e3c458-473d-4dcc-8313-63a5cf8266c8 tempest-AttachVolumeTestJSON-397034723 None] Deleting attachment 96d02fc8-bea3-4b73-9ef7-180a31c5a950. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:02 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.552s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:02 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 1G Sep 28 15:04:02 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:02 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 1G" returned: 0 in 0.714s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:02 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 Sep 28 15:04:02 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:03 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6" returned: 0 in 0.547s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:03 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 is being set with open permissions: ugo+rw Sep 28 15:04:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:03 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 Sep 28 15:04:03 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:03 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6" returned: 0 in 0.691s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dca97f61-ceab-4255-9367-e62564f528a8 tempest-SnapshotsActionsTest-1490931929 None] Create snapshot completed successfully Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-980f0cae-05c5-4aab-a3f7-a4423285c7c6-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-980f0cae-05c5-4aab-a3f7-a4423285c7c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-980f0cae-05c5-4aab-a3f7-a4423285c7c6" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-980f0cae-05c5-4aab-a3f7-a4423285c7c6" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Deleting offline snapshot 980f0cae-05c5-4aab-a3f7-a4423285c7c6 of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] snapshot_file for this snap is: volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ff9d4-43e8-4f4b-8050-1cc865e80806]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:05 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 Sep 28 15:04:05 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:05 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6" returned: 0 in 0.774s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[698a579b-576a-453b-ba2b-ef3c40dfce09]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:06 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:04:06 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:06 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.934s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:06 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 Sep 28 15:04:06 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Flow 'volume_create_manager' (db0af526-8d6e-4c8f-87f5-40058710aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9a2a01-3044-499e-9697-dc9cf9096427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9a2a01-3044-499e-9697-dc9cf9096427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-390595390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f164ff6b-a32f-4a79-b4f4-a8c74be8c850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d3120d09534f5d9fe99efd1f605cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:07Z,use_quota=True,user_id='195257f1dfa94a458154cc4aaa95b75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb5484f-00a2-4e2f-a502-258d980b43b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb5484f-00a2-4e2f-a502-258d980b43b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c539413-b881-4e9f-97bc-219368ef9cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:04:07 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6" returned: 0 in 0.907s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:07 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6 Sep 28 15:04:07 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:08 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.980f0cae-05c5-4aab-a3f7-a4423285c7c6" returned: 0 in 0.635s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-980f0cae-05c5-4aab-a3f7-a4423285c7c6" released by "_delete_snapshot" :: held 3.529s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" released by "delete_snapshot" :: held 3.603s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c539413-b881-4e9f-97bc-219368ef9cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f164ff6b-a32f-4a79-b4f4-a8c74be8c850', 'volume_name': 'volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd89c9e6-7584-4b30-bf84-8c99b8634fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd89c9e6-7584-4b30-bf84-8c99b8634fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1e8e99-1664-45b6-9c76-392dbdb8b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Volume f164ff6b-a32f-4a79-b4f4-a8c74be8c850: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Trying to clone f164ff6b-a32f-4a79-b4f4-a8c74be8c850 from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd at location (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Created reservations ['7ae733fa-a87f-4ec0-83e0-c6f0c94f7a47', 'd46eb8ac-df91-4f80-b288-c0474a0d7fce', 'f686b5bb-4b2b-4c58-b783-a4fc0db020a2', '68320f20-1402-4088-81d9-bc21f537e511'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Delete snapshot completed successfully. Sep 28 15:04:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e0a5336e-2d24-4510-b004-3078c79e09ec tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-980f0cae-05c5-4aab-a3f7-a4423285c7c6-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:04:09 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[53240412-4273-4941-897a-a2d49f6c89f0]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:09 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD Sep 28 15:04:09 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Creating offline snapshot 42c06a06-a4c9-4bfe-b383-3b96509253be of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff301e-70f2-42cb-a161-5d9793e0cb17]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:09 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd is fetched for user 195257f1dfa94a458154cc4aaa95b75b. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:04:09 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:04:09 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b27b164-90a5-4eb7-a664-776f1461ddb9]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:10 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD Sep 28 15:04:10 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "cinder-63e5b4e4-5b6d-4248-a073-e468af10c83d-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-63e5b4e4-5b6d-4248-a073-e468af10c83d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "cinder-quobyte-63e5b4e4-5b6d-4248-a073-e468af10c83d" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-quobyte-63e5b4e4-5b6d-4248-a073-e468af10c83d" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b65a7-3de3-48f6-983e-64d221131cef]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:10 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.661s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:10 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be 1G Sep 28 15:04:10 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:10 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:10 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d Sep 28 15:04:10 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:10 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d" returned: 0 in 0.489s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:10 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d Sep 28 15:04:10 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:11 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be 1G" returned: 0 in 0.684s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:11 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be Sep 28 15:04:11 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:11 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-63e5b4e4-5b6d-4248-a073-e468af10c83d" returned: 0 in 0.334s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-quobyte-63e5b4e4-5b6d-4248-a073-e468af10c83d" released by "delete_volume" :: held 0.890s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Created reservations ['2881e656-c994-41fb-992d-3a465398bd32', '0bcc625a-b428-40c7-acab-6e4af46b3e81', '0ac852f0-3bd1-4048-bed8-17f66d786353', 'ec12c732-d920-4e13-9dc0-714aea709bc9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:11 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be" returned: 0 in 0.421s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:11 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be is being set with open permissions: ugo+rw Sep 28 15:04:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:11 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:04:11 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:11 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be Sep 28 15:04:11 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:12 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.543s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Deleted volume successfully. Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a2dbbe93-35a8-47a7-9867-057044b644aa tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-63e5b4e4-5b6d-4248-a073-e468af10c83d-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:12 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be" returned: 0 in 0.636s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-390595390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f164ff6b-a32f-4a79-b4f4-a8c74be8c850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d3120d09534f5d9fe99efd1f605cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:07Z,use_quota=True,user_id='195257f1dfa94a458154cc4aaa95b75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Creating volume f164ff6b-a32f-4a79-b4f4-a8c74be8c850 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:12 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:12 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 1073741824 Sep 28 15:04:12 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-07092504-8693-4090-8606-ebea14e88e75 tempest-SnapshotsActionsTest-1490931929 None] Create snapshot completed successfully Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "cinder-bc4a50c9-3b57-4808-91cc-428d78b4a79a-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-bc4a50c9-3b57-4808-91cc-428d78b4a79a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "cinder-quobyte-bc4a50c9-3b57-4808-91cc-428d78b4a79a" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-quobyte-bc4a50c9-3b57-4808-91cc-428d78b4a79a" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7abd2f-6ba0-42df-9ae9-6238d6ad7fa3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-42c06a06-a4c9-4bfe-b383-3b96509253be-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-42c06a06-a4c9-4bfe-b383-3b96509253be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:13 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a Sep 28 15:04:13 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" acquired by "delete_snapshot" :: waited 0.079s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Acquiring lock "cinder-quobyte-42c06a06-a4c9-4bfe-b383-3b96509253be" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-42c06a06-a4c9-4bfe-b383-3b96509253be" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Deleting offline snapshot 42c06a06-a4c9-4bfe-b383-3b96509253be of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] snapshot_file for this snap is: volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f031999-0792-440c-8276-d580c71766bf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:13 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 1073741824" returned: 0 in 1.258s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:13 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 Sep 28 15:04:13 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:13 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be Sep 28 15:04:13 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:13 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a" returned: 0 in 0.902s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:13 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a Sep 28 15:04:13 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:13 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850" returned: 0 in 0.460s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Attempting download of 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume f164ff6b-a32f-4a79-b4f4-a8c74be8c850. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c3342b-1819-4815-abf1-4a67df6d6f64]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_92dupu6u {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:14 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_92dupu6u Sep 28 15:04:14 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:14 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be" returned: 0 in 1.021s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b134f7-58fc-41eb-a3c4-f7cb7c22acfa]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:14 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc4a50c9-3b57-4808-91cc-428d78b4a79a" returned: 0 in 0.759s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-quobyte-bc4a50c9-3b57-4808-91cc-428d78b4a79a" released by "delete_volume" :: held 1.847s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Created reservations ['3a03be69-ca49-4431-b520-b3da0df30798', '99a9b1d3-227f-470b-9ad3-ec5545fea654', 'cd2caa9c-a34c-4fd1-aaab-d0e216047e45', '7ad7aa23-59ea-44fe-b469-38d2c3dfc9de'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:14 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:04:14 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:14 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_92dupu6u" returned: 0 in 0.724s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_92dupu6u {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_92dupu6u Sep 28 15:04:15 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:04:15 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.780s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be Sep 28 15:04:15 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_92dupu6u" returned: 1 in 0.466s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_92dupu6u' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fa7378-db43-430e-8740-9225403817f8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Deleted volume successfully. Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acac7a64-9b60-4132-8613-b330183be1b7 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-bc4a50c9-3b57-4808-91cc-428d78b4a79a-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:15 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD Sep 28 15:04:15 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd was qcow2, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be" returned: 0 in 0.584s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 Sep 28 15:04:15 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be Sep 28 15:04:16 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "cinder-2d8c2e36-88bc-429a-9449-3887484c0b5c-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-2d8c2e36-88bc-429a-9449-3887484c0b5c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:16 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.42c06a06-a4c9-4bfe-b383-3b96509253be" returned: 0 in 0.591s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-42c06a06-a4c9-4bfe-b383-3b96509253be" released by "_delete_snapshot" :: held 3.213s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" released by "delete_snapshot" :: held 3.267s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "cinder-quobyte-2d8c2e36-88bc-429a-9449-3887484c0b5c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-quobyte-2d8c2e36-88bc-429a-9449-3887484c0b5c" acquired by "delete_volume" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d647037-019a-4003-977b-1d2324cb4f8a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Created reservations ['5b709a97-1fd1-4f59-97ae-b4c93a026d18', '064781fe-c661-44c0-a487-70bbfd29423a', 'b0366944-2fad-4b60-9464-e337ecde6dfe', '4a959631-0af5-4345-95f4-84bfbb7836e6'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:16 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c Sep 28 15:04:16 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Delete snapshot completed successfully. Sep 28 15:04:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640dfe23-1d6b-4428-8333-845b3401e9ad tempest-SnapshotsActionsTest-1065482337 None] Lock "cinder-42c06a06-a4c9-4bfe-b383-3b96509253be-delete_snapshot" released by "delete_snapshot" :: held 3.719s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:17 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c" returned: 0 in 0.625s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:17 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c Sep 28 15:04:17 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:18 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2d8c2e36-88bc-429a-9449-3887484c0b5c" returned: 0 in 0.694s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-quobyte-2d8c2e36-88bc-429a-9449-3887484c0b5c" released by "delete_volume" :: held 1.405s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Created reservations ['9720c01d-3bd1-4933-bcad-e41215b90603', 'e476ac5e-a25a-49cc-993e-709f3805d744', 'a367b674-fdd1-4e29-883f-abf39be89617', '226a8b2b-b48a-45ea-a8cf-d58bc4a353fa'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:18 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:04:18 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "cinder-54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "cinder-quobyte-54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-quobyte-54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Deleting offline snapshot 54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 of volume 58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] snapshot_file for this snap is: volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab8bddd-4456-4012-a045-1b0c67cf3ab0]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:18 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:04:18 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:19 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.637s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Deleted volume successfully. Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1a138258-01f0-4bab-9dde-851ec1c8c774 tempest-AttachVolumeTestJSON-397034723 None] Lock "cinder-2d8c2e36-88bc-429a-9449-3887484c0b5c-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:19 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850" returned: 0 in 3.415s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_v4tjke_pdevstack@QuobyteHD, size 112.00 MB, duration 3.42 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:04:19 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Converted 112.00 MB image at 32.79 MB/s Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:19 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 1G Sep 28 15:04:19 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:19 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.668s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58f0a78d-8dc0-464e-ba87-32b70faba82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efa274f-ae6d-4b7d-a819-c7c22537518f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:19 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c Sep 28 15:04:19 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:19 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 1G" returned: 0 in 0.618s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Downloaded image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume f164ff6b-a32f-4a79-b4f4-a8c74be8c850 successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd for user 195257f1dfa94a458154cc4aaa95b75b is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:04:19 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Marking volume f164ff6b-a32f-4a79-b4f4-a8c74be8c850 as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Copying metadata from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd to f164ff6b-a32f-4a79-b4f4-a8c74be8c850. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Creating volume glance metadata for volume f164ff6b-a32f-4a79-b4f4-a8c74be8c850 backed by image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:04:20 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c" returned: 0 in 0.555s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:20 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:04:20 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1e8e99-1664-45b6-9c76-392dbdb8b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc21db6-8f8b-44e9-92e2-197e43b45173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:20 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Volume volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 (f164ff6b-a32f-4a79-b4f4-a8c74be8c850): created successfully Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc21db6-8f8b-44e9-92e2-197e43b45173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Flow 'volume_create_manager' (db0af526-8d6e-4c8f-87f5-40058710aadf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e80a8f85-8d11-4e62-9ea6-189f9ab272fb tempest-ServerActionsTestOtherA-1857447018 None] Created volume successfully. Sep 28 15:04:20 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.482s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:20 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7 Sep 28 15:04:20 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:20 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c.54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" returned: 0 in 0.498s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-quobyte-54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7" released by "_delete_snapshot" :: held 2.396s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" released by "delete_snapshot" :: held 2.442s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:21 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Created reservations ['6295a4e1-13b3-4d31-afb7-fbd427a86690', '0b331660-4a30-4ce4-8c8c-3b6c640bf6ee', '8a23449d-0d78-4a88-9016-a2387642822f', '3c1ab1d2-ef33-4d7c-a02b-3ca4c9d764da'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Delete snapshot completed successfully. Sep 28 15:04:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73528c96-6e32-462f-abfe-f5df15a09c20 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-54bcbf3b-bd49-4c7e-9cc1-0b53846fa5f7-delete_snapshot" released by "delete_snapshot" :: held 2.717s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "cinder-58f0a78d-8dc0-464e-ba87-32b70faba82c-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-58f0a78d-8dc0-464e-ba87-32b70faba82c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" acquired by "delete_volume" :: waited 0.046s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[af124d56-c7bc-4de2-b46e-b5c50f3fb9f8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:22 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c Sep 28 15:04:22 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:22 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c" returned: 0 in 0.677s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:23 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c Sep 28 15:04:23 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:23 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58f0a78d-8dc0-464e-ba87-32b70faba82c" returned: 0 in 0.552s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-quobyte-58f0a78d-8dc0-464e-ba87-32b70faba82c" released by "delete_volume" :: held 1.380s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Created reservations ['3b6d2fe9-e5fb-4202-85e3-1f104c0a8f89', 'bbb6f82b-7e38-420c-94b4-6385054b1b7e', '59beafd6-906f-4fbb-9d89-43e14e5172d7', '75b5ddbd-10df-4c80-9c1d-f9ea125d4b67'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:23 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:04:23 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:24 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.527s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:24 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Deleted volume successfully. Sep 28 15:04:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1eb868aa-1e80-458a-9be2-4ebcf282a159 tempest-SnapshotsActionsTest-1490931929 None] Lock "cinder-58f0a78d-8dc0-464e-ba87-32b70faba82c-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-9d1eaf8b-4ac6-4e2d-8121-cf3765b235d9 req-0951cafb-d7a6-4a7e-9682-15ad1c6b0a75 tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-9d1eaf8b-4ac6-4e2d-8121-cf3765b235d9 req-0951cafb-d7a6-4a7e-9682-15ad1c6b0a75 tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-9d1eaf8b-4ac6-4e2d-8121-cf3765b235d9 req-0951cafb-d7a6-4a7e-9682-15ad1c6b0a75 tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-9d1eaf8b-4ac6-4e2d-8121-cf3765b235d9 req-0951cafb-d7a6-4a7e-9682-15ad1c6b0a75 tempest-ServerActionsTestOtherA-1857447018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '758216d4-c0c4-4913-b39c-92880b6e259d', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-9d1eaf8b-4ac6-4e2d-8121-cf3765b235d9 req-0951cafb-d7a6-4a7e-9682-15ad1c6b0a75 tempest-ServerActionsTestOtherA-1857447018 None] attachment_update completed successfully. Sep 28 15:04:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 28 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:04:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Flow 'volume_create_manager' (e137c4ce-4e0d-4af4-b7b2-4ad015df0451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd7af15-7a37-4a24-a76c-eb7c627efd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd7af15-7a37-4a24-a76c-eb7c627efd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1548481260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97172a1-2880-4262-bbf8-fdc10bb2589d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93ad087b2e4404db165927524e3ea4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:34Z,use_quota=True,user_id='f5d8c1694e9e4b04bde2ce855fb6b955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172b8767-86f0-4e06-a863-da2f30ac70f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172b8767-86f0-4e06-a863-da2f30ac70f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b91cf4-2cb7-49bc-bfe6-871cf645c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b91cf4-2cb7-49bc-bfe6-871cf645c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97172a1-2880-4262-bbf8-fdc10bb2589d', 'volume_name': 'volume-d97172a1-2880-4262-bbf8-fdc10bb2589d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c3655d-d328-46c7-9991-f7b46d43db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c3655d-d328-46c7-9991-f7b46d43db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941f67bc-6607-407d-b297-93084234fae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:34 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Volume d97172a1-2880-4262-bbf8-fdc10bb2589d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97172a1-2880-4262-bbf8-fdc10bb2589d', 'volume_size': 1} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1548481260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97172a1-2880-4262-bbf8-fdc10bb2589d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93ad087b2e4404db165927524e3ea4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:34Z,use_quota=True,user_id='f5d8c1694e9e4b04bde2ce855fb6b955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Creating volume d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:34 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:04:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:34 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d 1073741824 Sep 28 15:04:34 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:35 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d 1073741824" returned: 0 in 0.877s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:35 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d Sep 28 15:04:35 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:35 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d" returned: 0 in 0.594s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941f67bc-6607-407d-b297-93084234fae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97172a1-2880-4262-bbf8-fdc10bb2589d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f9fc98-623b-47d3-8a22-5d1993df82b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Volume volume-d97172a1-2880-4262-bbf8-fdc10bb2589d (d97172a1-2880-4262-bbf8-fdc10bb2589d): created successfully Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f9fc98-623b-47d3-8a22-5d1993df82b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Flow 'volume_create_manager' (e137c4ce-4e0d-4af4-b7b2-4ad015df0451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-cb78f02a-fa97-4616-8eab-3b991ce1dc13 req-53488bee-eb96-4a53-b811-c9c3b683ed23 tempest-VolumesSnapshotsTestJSON-2095750786 None] Created volume successfully. Sep 28 15:04:37 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=95,cinder:UPDATE=85,cinder:DELETE=6,cinder:INSERT=21 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:37 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=89,cinder:SELECT=101,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Creating offline snapshot 0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 of volume d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:04:37 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31e154c-9c74-4d00-b235-60f4c7cff229]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:38 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d Sep 28 15:04:38 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:38 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d" returned: 0 in 1.193s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:38 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 1G Sep 28 15:04:38 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:39 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 1G" returned: 0 in 0.938s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97172a1-2880-4262-bbf8-fdc10bb2589d -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:39 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97172a1-2880-4262-bbf8-fdc10bb2589d -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 Sep 28 15:04:39 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:40 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97172a1-2880-4262-bbf8-fdc10bb2589d -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" returned: 0 in 0.631s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:40 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 is being set with open permissions: ugo+rw Sep 28 15:04:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:40 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 Sep 28 15:04:40 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:40 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" returned: 0 in 0.438s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:40 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.info Sep 28 15:04:40 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:41 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.info" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:41 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.info is being set with open permissions: ugo+rw Sep 28 15:04:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:41 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.info Sep 28 15:04:41 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:41 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.info" returned: 0 in 0.534s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-fe668eba-27a4-433a-8bbe-4dcfc4358642 req-c5dd56dd-be88-4ad2-86ef-d92d871e95fe tempest-VolumesSnapshotsTestJSON-2095750786 None] Create snapshot completed successfully Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Flow 'volume_create_manager' (fbe4bea4-65f4-4214-a873-4f2020eb0b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de72cdc-2b02-4586-a4f4-7897b1c545e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de72cdc-2b02-4586-a4f4-7897b1c545e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1656578138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e17d244-b50a-4e24-b4c2-b7d92e04dce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26245695e2784bda8a296547b7f89a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:42Z,use_quota=True,user_id='f2219e739e9347d0b78c5f44278500c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547784a7-76fb-4506-952e-6d21b846a0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547784a7-76fb-4506-952e-6d21b846a0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8551b04d-1f59-462f-9ffa-de3c5b281ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8551b04d-1f59-462f-9ffa-de3c5b281ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e17d244-b50a-4e24-b4c2-b7d92e04dce3', 'volume_name': 'volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42f0b49-9c4a-4309-b196-2df434385044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42f0b49-9c4a-4309-b196-2df434385044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa95280c-c551-4f1d-894b-a1883c5911d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Volume 9e17d244-b50a-4e24-b4c2-b7d92e04dce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3', 'volume_size': 1} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1656578138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e17d244-b50a-4e24-b4c2-b7d92e04dce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26245695e2784bda8a296547b7f89a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:42Z,use_quota=True,user_id='f2219e739e9347d0b78c5f44278500c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Creating volume 9e17d244-b50a-4e24-b4c2-b7d92e04dce3 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:42 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:04:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:42 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 1073741824 Sep 28 15:04:42 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "cinder-0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "cinder-quobyte-d97172a1-2880-4262-bbf8-fdc10bb2589d" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-quobyte-d97172a1-2880-4262-bbf8-fdc10bb2589d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "cinder-quobyte-0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-quobyte-0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Deleting offline snapshot 0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 of volume d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] snapshot_file for this snap is: volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc23daf-2db3-4041-8fe2-649c6060454d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:43 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 1073741824" returned: 0 in 0.966s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:43 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 Sep 28 15:04:43 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:43 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 Sep 28 15:04:43 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:43 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" returned: 0 in 0.672s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d97172a1-2880-4262-bbf8-fdc10bb2589d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8e15bf-e186-4171-b3f1-7b8055353449]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:44 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3" returned: 0 in 0.568s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa95280c-c551-4f1d-894b-a1883c5911d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad47a56-a3db-4049-a5ed-ce79f64576e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:44 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Volume volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 (9e17d244-b50a-4e24-b4c2-b7d92e04dce3): created successfully Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad47a56-a3db-4049-a5ed-ce79f64576e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Flow 'volume_create_manager' (fbe4bea4-65f4-4214-a873-4f2020eb0b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:44 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d Sep 28 15:04:44 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0da2b306-3ec3-4cb6-a553-85690f3ee813 tempest-AttachVolumeNegativeTest-760384332 None] Created volume successfully. Sep 28 15:04:44 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d" returned: 0 in 0.899s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:44 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 Sep 28 15:04:44 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:45 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" returned: 0 in 0.852s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:45 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9 Sep 28 15:04:45 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:46 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d.0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" returned: 0 in 0.769s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-quobyte-0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9" released by "_delete_snapshot" :: held 3.451s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-quobyte-d97172a1-2880-4262-bbf8-fdc10bb2589d" released by "delete_snapshot" :: held 3.511s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-22d92316-5c40-4d93-83fe-2c215d2da236 req-3b4196a9-4baa-462d-8c38-424321d65835 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-22d92316-5c40-4d93-83fe-2c215d2da236 req-3b4196a9-4baa-462d-8c38-424321d65835 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-22d92316-5c40-4d93-83fe-2c215d2da236 req-3b4196a9-4baa-462d-8c38-424321d65835 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG cinder.quota [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Created reservations ['89029071-2dd3-47e3-a9c3-822ede263273', 'a0f658dc-3393-481e-a16a-5c56de602a21', '6b4dc61a-c2e3-4fb1-ab0c-71e56c4bc0a2', '24bf13a7-cb54-426d-be42-1cea7e7a8ede'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-22d92316-5c40-4d93-83fe-2c215d2da236 req-3b4196a9-4baa-462d-8c38-424321d65835 tempest-AttachVolumeNegativeTest-760384332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63838fc2-3708-4677-8d6e-67f36b60174d', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Delete snapshot completed successfully. Sep 28 15:04:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-00d2127b-f726-4d7b-8caf-edd807fa68f8 req-520ebe73-6506-4fb7-bd58-f053af23ad7d tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-0bf10e74-a50d-44ed-93c1-2dfd6c47d9f9-delete_snapshot" released by "delete_snapshot" :: held 3.999s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-22d92316-5c40-4d93-83fe-2c215d2da236 req-3b4196a9-4baa-462d-8c38-424321d65835 tempest-AttachVolumeNegativeTest-760384332 None] attachment_update completed successfully. Sep 28 15:04:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "cinder-d97172a1-2880-4262-bbf8-fdc10bb2589d-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-d97172a1-2880-4262-bbf8-fdc10bb2589d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "cinder-quobyte-d97172a1-2880-4262-bbf8-fdc10bb2589d" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-quobyte-d97172a1-2880-4262-bbf8-fdc10bb2589d" acquired by "delete_volume" :: waited 0.071s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:47 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[203120f0-fec0-47f4-adb9-72290646f478]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:48 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d Sep 28 15:04:48 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:48 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d" returned: 0 in 0.977s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:48 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d Sep 28 15:04:48 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:49 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d97172a1-2880-4262-bbf8-fdc10bb2589d" returned: 0 in 0.379s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-quobyte-d97172a1-2880-4262-bbf8-fdc10bb2589d" released by "delete_volume" :: held 1.565s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG cinder.quota [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Created reservations ['7850bf52-b734-4517-bd1d-07b1cf09533f', '0c92f5d2-1948-4e03-a581-d9c9a36cf3c4', 'd2bb6ac7-0c4a-402a-a93e-685d7bbe354b', 'cf9aaa6a-f10f-40da-bf6e-16392748bb8c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:49 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:04:49 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:50 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.647s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:50 devstack cinder-volume[86384]: DEBUG cinder.manager [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:50 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Deleted volume successfully. Sep 28 15:04:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-18f40f4d-d717-4a97-a734-f134bce2a840 req-5c398e1e-8917-425b-9f84-28c2006364eb tempest-VolumesSnapshotsTestJSON-2095750786 None] Lock "cinder-d97172a1-2880-4262-bbf8-fdc10bb2589d-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-4b82f49b-dfc2-426e-bb80-b4de898ee1e5 req-609492a3-5596-4d49-bb7d-da261ad209f0 tempest-ServerActionsTestOtherA-1857447018 None] Terminate volume connection completed successfully. Sep 28 15:04:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-4b82f49b-dfc2-426e-bb80-b4de898ee1e5 req-609492a3-5596-4d49-bb7d-da261ad209f0 tempest-ServerActionsTestOtherA-1857447018 None] Deleting attachment 758216d4-c0c4-4913-b39c-92880b6e259d. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Flow 'volume_create_manager' (12367e03-a974-4eca-be93-b0bb7f0a06a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e405d4-b520-4d14-9ed6-ad97de070a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e405d4-b520-4d14-9ed6-ad97de070a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-917443244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8651759c-cf95-4a0e-b2de-458545f31125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e13f8cbdf814469b342f760b9517c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:54Z,use_quota=True,user_id='176956b9a2b34e95b132bc4c8e35d820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7c69e4-dd4b-435b-85ff-53ce3aa64aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7c69e4-dd4b-435b-85ff-53ce3aa64aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1c5b1d-540c-46b7-abe1-42be8a7d0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1c5b1d-540c-46b7-abe1-42be8a7d0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8651759c-cf95-4a0e-b2de-458545f31125', 'volume_name': 'volume-8651759c-cf95-4a0e-b2de-458545f31125', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2ee483-6158-4109-af13-fd26fa476fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2ee483-6158-4109-af13-fd26fa476fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc2944f-8bec-49b9-83ac-69e9bbb16fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:54 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Volume 8651759c-cf95-4a0e-b2de-458545f31125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8651759c-cf95-4a0e-b2de-458545f31125', 'volume_size': 1} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-917443244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8651759c-cf95-4a0e-b2de-458545f31125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e13f8cbdf814469b342f760b9517c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:54Z,use_quota=True,user_id='176956b9a2b34e95b132bc4c8e35d820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Creating volume 8651759c-cf95-4a0e-b2de-458545f31125 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:54 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:04:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:54 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 1073741824 Sep 28 15:04:54 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:55 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 1073741824" returned: 0 in 0.906s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:55 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 Sep 28 15:04:55 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-4b82f49b-dfc2-426e-bb80-b4de898ee1e5 req-d271a1cb-73f5-4030-862f-e48a26b48c2b tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:55 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125" returned: 0 in 0.369s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-4b82f49b-dfc2-426e-bb80-b4de898ee1e5 req-d271a1cb-73f5-4030-862f-e48a26b48c2b tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.048s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-4b82f49b-dfc2-426e-bb80-b4de898ee1e5 req-d271a1cb-73f5-4030-862f-e48a26b48c2b tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc2944f-8bec-49b9-83ac-69e9bbb16fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8651759c-cf95-4a0e-b2de-458545f31125', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e1d1cb-e934-4a74-9e8c-5ef5f011efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:55 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Volume volume-8651759c-cf95-4a0e-b2de-458545f31125 (8651759c-cf95-4a0e-b2de-458545f31125): created successfully Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e1d1cb-e934-4a74-9e8c-5ef5f011efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Flow 'volume_create_manager' (12367e03-a974-4eca-be93-b0bb7f0a06a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-4b82f49b-dfc2-426e-bb80-b4de898ee1e5 req-d271a1cb-73f5-4030-862f-e48a26b48c2b tempest-ServerActionsTestOtherA-1857447018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88ac8046-e0e9-4e64-a5f9-3bd405a87d3e', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d4fc0d4b-ddca-449d-9acf-69ab39070b08 tempest-VolumesServicesTestJSON-1124971739 None] Created volume successfully. Sep 28 15:04:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-4b82f49b-dfc2-426e-bb80-b4de898ee1e5 req-d271a1cb-73f5-4030-862f-e48a26b48c2b tempest-ServerActionsTestOtherA-1857447018 None] attachment_update completed successfully. Sep 28 15:04:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Acquiring lock "cinder-8651759c-cf95-4a0e-b2de-458545f31125-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Lock "cinder-8651759c-cf95-4a0e-b2de-458545f31125-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Acquiring lock "cinder-quobyte-8651759c-cf95-4a0e-b2de-458545f31125" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Lock "cinder-quobyte-8651759c-cf95-4a0e-b2de-458545f31125" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:56 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac533b-5faa-44d8-8d44-dc84e513a280]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:57 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 Sep 28 15:04:57 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:57 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125" returned: 0 in 1.066s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:58 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125 Sep 28 15:04:58 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Flow 'volume_create_manager' (81416a8d-6d59-4529-b55b-c7031089b20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d81fb1-bb58-4b68-abd6-aa78d27dddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d81fb1-bb58-4b68-abd6-aa78d27dddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1476722206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513eb170-3683-4508-8a62-49deedc2b29a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63c936d9909e4f1fac9df804d524ae1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:59Z,use_quota=True,user_id='9da6acb727d14957a2240a498daba83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09a2464-4482-44ed-83ae-fdaed1de214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09a2464-4482-44ed-83ae-fdaed1de214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b1d25-7735-4c82-9edd-586b8716a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b1d25-7735-4c82-9edd-586b8716a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513eb170-3683-4508-8a62-49deedc2b29a', 'volume_name': 'volume-513eb170-3683-4508-8a62-49deedc2b29a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa49782-9e47-4772-909d-8362d2143215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa49782-9e47-4772-909d-8362d2143215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8960e37-e052-4f8a-b1d0-7eb222636333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Volume 513eb170-3683-4508-8a62-49deedc2b29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513eb170-3683-4508-8a62-49deedc2b29a', 'volume_size': 1} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1476722206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513eb170-3683-4508-8a62-49deedc2b29a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63c936d9909e4f1fac9df804d524ae1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:59Z,use_quota=True,user_id='9da6acb727d14957a2240a498daba83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Creating volume 513eb170-3683-4508-8a62-49deedc2b29a {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:58 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8651759c-cf95-4a0e-b2de-458545f31125" returned: 0 in 0.774s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Lock "cinder-quobyte-8651759c-cf95-4a0e-b2de-458545f31125" released by "delete_volume" :: held 1.938s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:58 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a 1073741824 Sep 28 15:04:58 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Created reservations ['b829781e-34b1-4648-8974-fd130551c593', '02379514-6f7b-4191-b501-9cd82839e7c8', '47a2a28d-1f73-4dc3-8c54-66baee894aad', '786f42b3-c102-42d7-af8e-e4d3549b678b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:59 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:04:59 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:59 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.829s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:59 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Deleted volume successfully. Sep 28 15:05:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bba923e-5e16-457c-af32-a2b2c97a01c5 tempest-VolumesServicesTestJSON-1124971739 None] Lock "cinder-8651759c-cf95-4a0e-b2de-458545f31125-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:00 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a 1073741824" returned: 0 in 1.553s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:00 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a Sep 28 15:05:00 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:01 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a" returned: 0 in 0.829s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] <== create_volume: return (2502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.511s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8960e37-e052-4f8a-b1d0-7eb222636333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513eb170-3683-4508-8a62-49deedc2b29a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6874df4c-0ec9-4113-bacd-ccf09165e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Volume volume-513eb170-3683-4508-8a62-49deedc2b29a (513eb170-3683-4508-8a62-49deedc2b29a): created successfully Sep 28 15:05:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6874df4c-0ec9-4113-bacd-ccf09165e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Flow 'volume_create_manager' (81416a8d-6d59-4529-b55b-c7031089b20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5e362297-bb55-4732-9525-379974d2eddd tempest-VolumesTestJSON-1596479596 None] Created volume successfully. Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Flow 'volume_create_manager' (98349659-2274-41ae-bb52-6a6e459d2f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6b2aeb-d21d-452d-9165-f50e31953d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6b2aeb-d21d-452d-9165-f50e31953d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-843156580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe083be-58f8-4e39-83f1-8392cb013de6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63c936d9909e4f1fac9df804d524ae1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:03Z,use_quota=True,user_id='9da6acb727d14957a2240a498daba83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17c9a27-fa7d-4b4e-941a-d1d5c8d5d2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17c9a27-fa7d-4b4e-941a-d1d5c8d5d2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5e6b33-d63f-4bc0-95f7-672639807b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5e6b33-d63f-4bc0-95f7-672639807b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe083be-58f8-4e39-83f1-8392cb013de6', 'volume_name': 'volume-4fe083be-58f8-4e39-83f1-8392cb013de6', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c272f2f2-5ac9-4a59-84f0-7258fe20047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c272f2f2-5ac9-4a59-84f0-7258fe20047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3ddf63-bb9b-4306-8e7c-986815d75114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Volume 4fe083be-58f8-4e39-83f1-8392cb013de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe083be-58f8-4e39-83f1-8392cb013de6', 'volume_size': 1} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-843156580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe083be-58f8-4e39-83f1-8392cb013de6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63c936d9909e4f1fac9df804d524ae1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:03Z,use_quota=True,user_id='9da6acb727d14957a2240a498daba83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Creating volume 4fe083be-58f8-4e39-83f1-8392cb013de6 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:03 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:05:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:03 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 1073741824 Sep 28 15:05:03 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:04 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 1073741824" returned: 0 in 0.866s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:04 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 Sep 28 15:05:04 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:04 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6" returned: 0 in 0.486s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3ddf63-bb9b-4306-8e7c-986815d75114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe083be-58f8-4e39-83f1-8392cb013de6', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8466a768-3ad1-49f6-9637-b998dc5d048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Volume volume-4fe083be-58f8-4e39-83f1-8392cb013de6 (4fe083be-58f8-4e39-83f1-8392cb013de6): created successfully Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8466a768-3ad1-49f6-9637-b998dc5d048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Flow 'volume_create_manager' (98349659-2274-41ae-bb52-6a6e459d2f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0c01f690-7748-4c44-aa5e-26fd18c31bba tempest-VolumesTestJSON-1596479596 None] Created volume successfully. Sep 28 15:05:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Flow 'volume_create_manager' (257fa9a0-9430-49a8-a47e-c4c248f2a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194eb6a2-8b5c-41e2-a9fd-4bef739fb6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194eb6a2-8b5c-41e2-a9fd-4bef739fb6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1499737300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794c3d4f-329c-4587-8014-af0aae02325b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63c936d9909e4f1fac9df804d524ae1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:07Z,use_quota=True,user_id='9da6acb727d14957a2240a498daba83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40560ce-47ab-4a0e-8258-270bd8db8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40560ce-47ab-4a0e-8258-270bd8db8479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1531ab-a16a-46df-be74-34a5ff1e4846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1531ab-a16a-46df-be74-34a5ff1e4846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794c3d4f-329c-4587-8014-af0aae02325b', 'volume_name': 'volume-794c3d4f-329c-4587-8014-af0aae02325b', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c2a7be-5526-4c58-bacb-cd045e97c3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c2a7be-5526-4c58-bacb-cd045e97c3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548268c0-6618-4de0-a360-da5814e7602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Volume 794c3d4f-329c-4587-8014-af0aae02325b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794c3d4f-329c-4587-8014-af0aae02325b', 'volume_size': 1} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1499737300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794c3d4f-329c-4587-8014-af0aae02325b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63c936d9909e4f1fac9df804d524ae1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:07Z,use_quota=True,user_id='9da6acb727d14957a2240a498daba83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Creating volume 794c3d4f-329c-4587-8014-af0aae02325b {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:07 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:05:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:07 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b 1073741824 Sep 28 15:05:07 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:08 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b 1073741824" returned: 0 in 1.353s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:08 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b Sep 28 15:05:08 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:09 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b" returned: 0 in 0.630s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548268c0-6618-4de0-a360-da5814e7602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794c3d4f-329c-4587-8014-af0aae02325b', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2144789-5d4a-4769-a6e9-74867cab7943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:09 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Volume volume-794c3d4f-329c-4587-8014-af0aae02325b (794c3d4f-329c-4587-8014-af0aae02325b): created successfully Sep 28 15:05:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2144789-5d4a-4769-a6e9-74867cab7943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Flow 'volume_create_manager' (257fa9a0-9430-49a8-a47e-c4c248f2a75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7f87cca3-e4f4-4e27-82d4-1db3968cefa5 tempest-VolumesTestJSON-1596479596 None] Created volume successfully. Sep 28 15:05:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Acquiring lock "cinder-794c3d4f-329c-4587-8014-af0aae02325b-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Lock "cinder-794c3d4f-329c-4587-8014-af0aae02325b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Acquiring lock "cinder-quobyte-794c3d4f-329c-4587-8014-af0aae02325b" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Lock "cinder-quobyte-794c3d4f-329c-4587-8014-af0aae02325b" acquired by "delete_volume" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae8f1f-d64d-430a-815a-d3a047d20315]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:14 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b Sep 28 15:05:14 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:15 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b" returned: 0 in 0.879s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:15 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b Sep 28 15:05:15 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:15 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-794c3d4f-329c-4587-8014-af0aae02325b" returned: 0 in 0.572s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Lock "cinder-quobyte-794c3d4f-329c-4587-8014-af0aae02325b" released by "delete_volume" :: held 1.553s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:15 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Created reservations ['2c0d54b4-7906-48ff-91a1-b411b163aacc', '8961f12f-05bb-4a1e-abb9-bbbfab7a2fa1', '3be8f8cf-38cb-4f89-a8a4-0b76f3c669c1', '25e9b5cf-7b20-4002-9f5e-09b3bd2ca7b4'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:16 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:05:16 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:16 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "cinder-4fe083be-58f8-4e39-83f1-8392cb013de6-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.413s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Deleted volume successfully. Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-4fe083be-58f8-4e39-83f1-8392cb013de6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ff6e09c-cd47-4e44-bbcb-234b9c86f98a tempest-VolumesTestJSON-1596479596 None] Lock "cinder-794c3d4f-329c-4587-8014-af0aae02325b-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "cinder-quobyte-4fe083be-58f8-4e39-83f1-8392cb013de6" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-quobyte-4fe083be-58f8-4e39-83f1-8392cb013de6" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[58879f9e-c281-4399-9872-3ee9f1e60950]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:16 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 Sep 28 15:05:16 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6" returned: 0 in 0.578s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6 Sep 28 15:05:17 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4fe083be-58f8-4e39-83f1-8392cb013de6" returned: 0 in 0.458s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-quobyte-4fe083be-58f8-4e39-83f1-8392cb013de6" released by "delete_volume" :: held 1.129s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:17 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Created reservations ['09f542b1-f25f-4f25-99eb-4a72eed3a77a', '921b79ce-6cc0-4d12-9ed2-e5ebf4a9f6bb', '8a78db74-d3f8-46c6-be0c-bd00ada5a5b0', '24107a44-4b71-4a52-aa86-e78ef83f719c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:18 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:05:18 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:18 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.353s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Deleted volume successfully. Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e86fbdf-a016-448e-8c50-14564fb093f6 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-4fe083be-58f8-4e39-83f1-8392cb013de6-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "cinder-513eb170-3683-4508-8a62-49deedc2b29a-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-513eb170-3683-4508-8a62-49deedc2b29a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "cinder-quobyte-513eb170-3683-4508-8a62-49deedc2b29a" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-quobyte-513eb170-3683-4508-8a62-49deedc2b29a" acquired by "delete_volume" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93c28ce-f533-4efc-969c-1254f330c340]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:19 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a Sep 28 15:05:19 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:19 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:19 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a Sep 28 15:05:19 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-513eb170-3683-4508-8a62-49deedc2b29a" returned: 0 in 0.442s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-quobyte-513eb170-3683-4508-8a62-49deedc2b29a" released by "delete_volume" :: held 0.970s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Created reservations ['eb17f5ea-ce5d-463b-9306-148431307bc2', '54b9ac4d-f38f-423c-b7f4-95896742c690', '33f59724-cf7f-4b51-b55a-a4720b3b29c7', '7d0f1962-4a6b-45a0-b89c-6f1000aa87ff'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:05:20 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.415s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Deleted volume successfully. Sep 28 15:05:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bfde5bcc-1cd5-4675-b8a3-c369b9b1cf16 tempest-VolumesTestJSON-1596479596 None] Lock "cinder-513eb170-3683-4508-8a62-49deedc2b29a-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=56,cinder:INSERT=15,cinder:DELETE=6,cinder:UPDATE=66 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:30 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=59,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:33 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:05:33 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:34 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.467s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 28 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:05:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:05:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-387d7038-de09-455d-96a0-00641a4168c0 req-20b5ec7c-48ce-4d09-b319-61e4913d4c95 tempest-ServerActionsTestOtherA-1857447018 None] Terminate volume connection completed successfully. Sep 28 15:05:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-387d7038-de09-455d-96a0-00641a4168c0 req-20b5ec7c-48ce-4d09-b319-61e4913d4c95 tempest-ServerActionsTestOtherA-1857447018 None] Deleting attachment 88ac8046-e0e9-4e64-a5f9-3bd405a87d3e. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "cinder-f164ff6b-a32f-4a79-b4f4-a8c74be8c850-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-f164ff6b-a32f-4a79-b4f4-a8c74be8c850-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-29dc04cc-2d54-4811-a1a9-6ef7f504a4d1 tempest-GroupSnapshotsTest-345363750 None] Group tempest-GroupSnapshotsTest-Group-1871149474: creating Sep 28 15:05:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "cinder-quobyte-f164ff6b-a32f-4a79-b4f4-a8c74be8c850" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-quobyte-f164ff6b-a32f-4a79-b4f4-a8c74be8c850" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-29dc04cc-2d54-4811-a1a9-6ef7f504a4d1 tempest-GroupSnapshotsTest-345363750 None] Group tempest-GroupSnapshotsTest-Group-1871149474: created successfully Sep 28 15:05:36 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[34848a29-d107-473e-8ced-b9c7c34a819a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-29dc04cc-2d54-4811-a1a9-6ef7f504a4d1 tempest-GroupSnapshotsTest-345363750 None] Create group completed successfully. Sep 28 15:05:36 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 Sep 28 15:05:36 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:37 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850" returned: 0 in 0.682s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:37 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850 Sep 28 15:05:37 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:37 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f164ff6b-a32f-4a79-b4f4-a8c74be8c850" returned: 0 in 0.513s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-quobyte-f164ff6b-a32f-4a79-b4f4-a8c74be8c850" released by "delete_volume" :: held 1.310s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:37 devstack cinder-volume[86384]: DEBUG cinder.quota [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Created reservations ['76d76122-8eed-4c48-bfc9-36c7ca352cb1', 'e423a590-8f3d-4ad1-9b46-bef0567c75b7', 'a45d95a0-510d-4397-a9ad-1d69b835ba41', 'c13e93c1-cae0-4a06-aa3d-0a9a63ec9508'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:38 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:05:38 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:38 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.371s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.manager [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:38 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Deleted volume successfully. Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-387d7038-de09-455d-96a0-00641a4168c0 req-f8385af6-c8f1-4970-b373-17c10d28fc25 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-f164ff6b-a32f-4a79-b4f4-a8c74be8c850-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (b1780ecd-f1fb-49ef-a22f-f6255ab5d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dd5583-8461-4493-8a56-2c5cb609a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dd5583-8461-4493-8a56-2c5cb609a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-776838613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43ee9d1f-e35f-4781-a661-452ba154d526,host='devstack@QuobyteHD#QuobyteHD',id=9def3296-d33c-4a5a-9c47-e3eaedc7bf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:39Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cadc0c8-405d-4d6a-99fb-f0c86c25b97d),volume_type_id=7cadc0c8-405d-4d6a-99fb-f0c86c25b97d)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931998a1-08fa-4ed3-a6b5-39cd79c47440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931998a1-08fa-4ed3-a6b5-39cd79c47440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48709548-09f6-469d-a1e4-1fcf8c3c4b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48709548-09f6-469d-a1e4-1fcf8c3c4b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9def3296-d33c-4a5a-9c47-e3eaedc7bf7c', 'volume_name': 'volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f400f19a-8863-473f-87c0-a93e6d0d6fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f400f19a-8863-473f-87c0-a93e6d0d6fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195d9828-5261-4bf9-81f8-5addd73cdd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:38 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Volume 9def3296-d33c-4a5a-9c47-e3eaedc7bf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c', 'volume_size': 1} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43ee9d1f-e35f-4781-a661-452ba154d526,created_at=2026-09-28T13:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-776838613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43ee9d1f-e35f-4781-a661-452ba154d526,host='devstack@QuobyteHD#QuobyteHD',id=9def3296-d33c-4a5a-9c47-e3eaedc7bf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:39Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cadc0c8-405d-4d6a-99fb-f0c86c25b97d),volume_type_id=7cadc0c8-405d-4d6a-99fb-f0c86c25b97d)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Creating volume 9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:38 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:05:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:38 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c 1073741824 Sep 28 15:05:38 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "cinder-f991e124-2ed1-4ae9-ac8c-3025dfaba823-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-f991e124-2ed1-4ae9-ac8c-3025dfaba823-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:39 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c 1073741824" returned: 0 in 0.745s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "cinder-quobyte-f991e124-2ed1-4ae9-ac8c-3025dfaba823" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-quobyte-f991e124-2ed1-4ae9-ac8c-3025dfaba823" acquired by "delete_volume" :: waited 0.045s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:39 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c Sep 28 15:05:39 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6086e70-02a1-4e8d-9d2c-1b1f8ea17407]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:39 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 Sep 28 15:05:39 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:39 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" returned: 0 in 0.336s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195d9828-5261-4bf9-81f8-5addd73cdd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2031a0a-2fac-4fe6-80e5-0ccd86b1ef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Volume volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c (9def3296-d33c-4a5a-9c47-e3eaedc7bf7c): created successfully Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2031a0a-2fac-4fe6-80e5-0ccd86b1ef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (b1780ecd-f1fb-49ef-a22f-f6255ab5d32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:40 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-926c77d0-5fd6-4e07-86e9-e922494fe96e tempest-GroupSnapshotsTest-345363750 None] Created volume successfully. Sep 28 15:05:40 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823" returned: 0 in 0.582s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:40 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823 Sep 28 15:05:40 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:40 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f991e124-2ed1-4ae9-ac8c-3025dfaba823" returned: 0 in 0.356s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-quobyte-f991e124-2ed1-4ae9-ac8c-3025dfaba823" released by "delete_volume" :: held 1.012s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Created reservations ['60cdc0bb-a20a-4ab5-a158-d5cb4ad1eff6', 'c556fe69-a286-40c0-a1d0-14592cb15087', 'aa0eff29-1284-41c3-9b0a-48b329cdffb8', 'e7140ab4-26d7-4234-b869-53743eb1a600'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:40 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:05:40 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:41 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.363s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Deleted volume successfully. Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3d5f3b3a-ae1b-4fcf-af74-d0ef4beee288 tempest-ServerActionsTestOtherA-1857447018 None] Lock "cinder-f991e124-2ed1-4ae9-ac8c-3025dfaba823-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-d5989713-94cc-4280-bdd6-b4045aab87f1 req-046cc7ca-805f-41c3-9327-9b2f6cb3ad66 tempest-AttachVolumeNegativeTest-760384332 None] Terminate volume connection completed successfully. Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-d5989713-94cc-4280-bdd6-b4045aab87f1 req-046cc7ca-805f-41c3-9327-9b2f6cb3ad66 tempest-AttachVolumeNegativeTest-760384332 None] Deleting attachment 63838fc2-3708-4677-8d6e-67f36b60174d. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] GroupSnapshot 00004502-3f6d-4170-9ded-0b8beef49b88: creating. Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Group snapshot 00004502-3f6d-4170-9ded-0b8beef49b88: creating. {{(pid=86384) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Creating offline snapshot 66d109ae-cd10-48ef-99ab-5f175afed6eb of volume 9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f498fbd-2e51-4ca2-8c7d-519264f80557]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:42 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c Sep 28 15:05:42 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:42 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" returned: 0 in 0.878s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:42 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb 1G Sep 28 15:05:42 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:43 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb 1G" returned: 0 in 0.794s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:43 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb Sep 28 15:05:43 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb" returned: 0 in 0.488s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:44 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:05:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:44 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb Sep 28 15:05:44 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb" returned: 0 in 0.407s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:44 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.info Sep 28 15:05:44 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.info" returned: 0 in 0.437s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:45 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:05:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:45 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.info Sep 28 15:05:45 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:45 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.info" returned: 0 in 0.430s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.661s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a98f295b-069e-44a2-896a-ea5aa0fd6400 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 00004502-3f6d-4170-9ded-0b8beef49b88: created successfully Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-66d109ae-cd10-48ef-99ab-5f175afed6eb-5fe3844d-1b6a-46b6-badd-64af41087cf7" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-66d109ae-cd10-48ef-99ab-5f175afed6eb-5fe3844d-1b6a-46b6-badd-64af41087cf7" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Creating volume 5fe3844d-1b6a-46b6-badd-64af41087cf7 from snapshot 66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-5fe3844d-1b6a-46b6-badd-64af41087cf7" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-5fe3844d-1b6a-46b6-badd-64af41087cf7" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] snapshot: 66d109ae-cd10-48ef-99ab-5f175afed6eb, volume: 5fe3844d-1b6a-46b6-badd-64af41087cf7, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fdc88b-6987-40dc-91a3-9b8427a637bf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb Sep 28 15:05:47 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb" returned: 0 in 0.672s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fb098b-147a-4988-aea2-f119e9069ba7]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c Sep 28 15:05:48 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" returned: 0 in 0.551s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:05:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 Sep 28 15:05:49 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:57 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:57 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:58 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7" returned: 0 in 9.504s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:58 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c, size 1024.00 MB, duration 9.50 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:05:58 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Converted 1024.00 MB image at 107.73 MB/s Sep 28 15:05:58 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:05:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:58 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 Sep 28 15:05:58 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:58 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-5fe3844d-1b6a-46b6-badd-64af41087cf7" released by "_copy_volume_from_snapshot" :: held 11.210s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-66d109ae-cd10-48ef-99ab-5f175afed6eb-5fe3844d-1b6a-46b6-badd-64af41087cf7" released by "_create_volume_from_snapshot" :: held 11.312s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.346s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-99653541-8ea5-4190-acf6-6d7b377e863b tempest-GroupSnapshotsTest-345363750 None] Create group from source-snapshot-00004502-3f6d-4170-9ded-0b8beef49b88 completed successfully. Sep 28 15:05:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-5fe3844d-1b6a-46b6-badd-64af41087cf7" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-5fe3844d-1b6a-46b6-badd-64af41087cf7" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f67138c-52fc-4332-8ea6-7aebd4869738]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:00 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 Sep 28 15:06:00 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:00 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7" returned: 0 in 0.580s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:00 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7 Sep 28 15:06:00 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:00 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fe3844d-1b6a-46b6-badd-64af41087cf7" returned: 0 in 0.378s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-5fe3844d-1b6a-46b6-badd-64af41087cf7" released by "delete_volume" :: held 1.036s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Created reservations ['be1e8f93-95f9-475a-895b-917f8b70ad33'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:01 devstack cinder-volume[86384]: WARNING cinder.quota [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-424892635 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-424892635, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:01 devstack cinder-volume[86384]: WARNING cinder.quota [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-424892635 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-424892635, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Created reservations ['1085f1a7-dedb-4da7-85f8-cd88c30b4487', '1c8f8afc-3ed6-4bcc-b9ea-1ae26c05e3cc', 'c8f8bb3b-5893-4222-8a57-ce3f3e79c437', '883cbeb4-7117-41b1-9fe3-1ea539e7fc62'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:01 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:06:01 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:01 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.272s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:01 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-001b7fc0-5bce-43fd-b18d-5b541dced84b tempest-GroupSnapshotsTest-345363750 None] Delete group completed successfully. Sep 28 15:06:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] group_snapshot 00004502-3f6d-4170-9ded-0b8beef49b88: deleting Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] group_snapshot 00004502-3f6d-4170-9ded-0b8beef49b88: deleting {{(pid=86384) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-66d109ae-cd10-48ef-99ab-5f175afed6eb" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-66d109ae-cd10-48ef-99ab-5f175afed6eb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Deleting offline snapshot 66d109ae-cd10-48ef-99ab-5f175afed6eb of volume 9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] snapshot_file for this snap is: volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[061896b1-8638-4899-a980-6bd79e2c0807]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:03 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb Sep 28 15:06:03 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:03 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb" returned: 0 in 0.577s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf669d10-590b-4eb6-93bd-6237e6454f71]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:03 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c Sep 28 15:06:03 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:04 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" returned: 0 in 0.831s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:04 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb Sep 28 15:06:04 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:05 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb" returned: 0 in 0.811s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:05 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb Sep 28 15:06:05 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:05 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c.66d109ae-cd10-48ef-99ab-5f175afed6eb" returned: 0 in 0.581s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-66d109ae-cd10-48ef-99ab-5f175afed6eb" released by "_delete_snapshot" :: held 3.014s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" released by "delete_snapshot" :: held 3.056s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:05 devstack cinder-volume[86384]: WARNING cinder.quota [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-424892635 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-424892635, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:06 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] Created reservations ['a2d1275b-9eb0-4575-a479-0c8b41473ffa', '594e158d-c085-48a2-898a-bcb404e7111d', 'abb599ad-00d4-4f71-9d2a-af515f530f25', 'dcf4c8b4-1e30-42c4-8d61-22273f8c5829'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0ccfbcd5-85d0-4fb9-8060-f3728236d65f tempest-GroupSnapshotsTest-345363750 None] group_snapshot 00004502-3f6d-4170-9ded-0b8beef49b88: deleted successfully Sep 28 15:06:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:07 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a18e7-651a-4500-a932-f584dfeb80b3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:07 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c Sep 28 15:06:07 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:07 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" returned: 0 in 0.742s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:07 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c Sep 28 15:06:07 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:08 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" returned: 0 in 0.506s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-9def3296-d33c-4a5a-9c47-e3eaedc7bf7c" released by "delete_volume" :: held 1.429s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['68404860-f196-48fc-9969-92a3bdd29690'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:08 devstack cinder-volume[86384]: WARNING cinder.db.api [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-424892635'] Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['efa33e59-d9f9-4645-89a0-b6d3332841f7', '47f364d6-5331-4798-81f6-244e79e42810', 'f650409a-84c2-44d7-8caa-bd114eed72bc', 'f2fbacca-35a7-4423-95b5-760c43f397a9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:08 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:06:08 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:09 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.381s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:09 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-983af240-48f6-4c8b-b299-1d70e76a0e47 tempest-GroupSnapshotsTest-345363750 None] Delete group completed successfully. Sep 28 15:06:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e5870e4a-d02c-4e91-9216-e1326e4f94bb tempest-GroupSnapshotsTest-345363750 None] Group tempest-GroupSnapshotsTest-Group-1748557421: creating Sep 28 15:06:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e5870e4a-d02c-4e91-9216-e1326e4f94bb tempest-GroupSnapshotsTest-345363750 None] Group tempest-GroupSnapshotsTest-Group-1748557421: created successfully Sep 28 15:06:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e5870e4a-d02c-4e91-9216-e1326e4f94bb tempest-GroupSnapshotsTest-345363750 None] Create group completed successfully. Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (cd33e354-1251-478c-9a37-55933ecbc9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dff9d0-eb4d-4af4-bf4a-5a5e605edd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dff9d0-eb4d-4af4-bf4a-5a5e605edd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860216091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4262824-f08a-4663-b2a7-48bfca4cf1eb,host='devstack@QuobyteHD#QuobyteHD',id=f0e154ce-f90f-4179-a953-c24e45bc6158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:12Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb001f35-92b9-41ac-8386-e27fcec915a4),volume_type_id=bb001f35-92b9-41ac-8386-e27fcec915a4)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35363fbb-3205-49d0-8f3c-feb587f86cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35363fbb-3205-49d0-8f3c-feb587f86cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f16e697-a02c-485b-b63c-7a582ad036ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f16e697-a02c-485b-b63c-7a582ad036ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e154ce-f90f-4179-a953-c24e45bc6158', 'volume_name': 'volume-f0e154ce-f90f-4179-a953-c24e45bc6158', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9b8fc5-b8a5-4927-a0f2-cc5e983a9287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9b8fc5-b8a5-4927-a0f2-cc5e983a9287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d55c11a-cc65-4b78-bc4b-855787717457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Volume f0e154ce-f90f-4179-a953-c24e45bc6158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e154ce-f90f-4179-a953-c24e45bc6158', 'volume_size': 1} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4262824-f08a-4663-b2a7-48bfca4cf1eb,created_at=2026-09-28T13:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860216091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4262824-f08a-4663-b2a7-48bfca4cf1eb,host='devstack@QuobyteHD#QuobyteHD',id=f0e154ce-f90f-4179-a953-c24e45bc6158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:12Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb001f35-92b9-41ac-8386-e27fcec915a4),volume_type_id=bb001f35-92b9-41ac-8386-e27fcec915a4)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Creating volume f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:12 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:06:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:12 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 1073741824 Sep 28 15:06:12 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:13 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 1073741824" returned: 0 in 0.638s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:13 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 Sep 28 15:06:13 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:13 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158" returned: 0 in 0.465s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d55c11a-cc65-4b78-bc4b-855787717457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e154ce-f90f-4179-a953-c24e45bc6158', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec413b90-35d6-42e6-b810-8a2fc6b82a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:13 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Volume volume-f0e154ce-f90f-4179-a953-c24e45bc6158 (f0e154ce-f90f-4179-a953-c24e45bc6158): created successfully Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec413b90-35d6-42e6-b810-8a2fc6b82a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (cd33e354-1251-478c-9a37-55933ecbc9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:13 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2499084e-ff24-4b8c-af30-03c9cbc128ed tempest-GroupSnapshotsTest-345363750 None] Created volume successfully. Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (2158d32d-f25b-40af-bb4e-e835765c05fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471a879d-906d-4e0b-8684-c84868124836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471a879d-906d-4e0b-8684-c84868124836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157030882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4262824-f08a-4663-b2a7-48bfca4cf1eb,host='devstack@QuobyteHD#QuobyteHD',id=2c7606e9-e14a-4516-93f7-cb07694e655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:16Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb001f35-92b9-41ac-8386-e27fcec915a4),volume_type_id=bb001f35-92b9-41ac-8386-e27fcec915a4)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ee4f40-790a-473b-9012-cdffd5b10389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ee4f40-790a-473b-9012-cdffd5b10389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469db633-2ba3-4bca-b7b3-d92460aca516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469db633-2ba3-4bca-b7b3-d92460aca516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7606e9-e14a-4516-93f7-cb07694e655b', 'volume_name': 'volume-2c7606e9-e14a-4516-93f7-cb07694e655b', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27531aa-9cfe-43c2-af2f-04b1ca9c40f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27531aa-9cfe-43c2-af2f-04b1ca9c40f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa735aea-68a8-4b6b-b7dc-03c6c0a490a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Volume 2c7606e9-e14a-4516-93f7-cb07694e655b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7606e9-e14a-4516-93f7-cb07694e655b', 'volume_size': 1} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4262824-f08a-4663-b2a7-48bfca4cf1eb,created_at=2026-09-28T13:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157030882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4262824-f08a-4663-b2a7-48bfca4cf1eb,host='devstack@QuobyteHD#QuobyteHD',id=2c7606e9-e14a-4516-93f7-cb07694e655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:16Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb001f35-92b9-41ac-8386-e27fcec915a4),volume_type_id=bb001f35-92b9-41ac-8386-e27fcec915a4)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Creating volume 2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:15 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:06:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:15 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b 1073741824 Sep 28 15:06:15 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:16 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b 1073741824" returned: 0 in 0.957s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:17 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b Sep 28 15:06:17 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:17 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b" returned: 0 in 0.516s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa735aea-68a8-4b6b-b7dc-03c6c0a490a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7606e9-e14a-4516-93f7-cb07694e655b', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9267a146-c310-45bc-bf71-1fcffa088551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:17 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Volume volume-2c7606e9-e14a-4516-93f7-cb07694e655b (2c7606e9-e14a-4516-93f7-cb07694e655b): created successfully Sep 28 15:06:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9267a146-c310-45bc-bf71-1fcffa088551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (2158d32d-f25b-40af-bb4e-e835765c05fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-32661595-6af9-49e3-ad43-3386d77be907 tempest-GroupSnapshotsTest-345363750 None] Created volume successfully. Sep 28 15:06:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1140450d-56f2-4784-a40f-95a4a5c573dd tempest-GroupSnapshotsTest-345363750 None] Update group completed successfully. Sep 28 15:06:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-70890592-8e7e-4db6-8f16-fb7f3b558972 tempest-GroupSnapshotsTest-345363750 None] Update group completed successfully. Sep 28 15:06:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bca2d724-66ce-4580-ad6e-e504be34f6a9 tempest-GroupSnapshotsTest-345363750 None] Update group completed successfully. Sep 28 15:06:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-42ed5d62-c460-4b9a-86f3-1ea1f37d20ad tempest-GroupSnapshotsTest-345363750 None] Update group completed successfully. Sep 28 15:06:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] GroupSnapshot 181acb66-4ab4-42f7-b928-b6c4071d9a26: creating. Sep 28 15:06:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Group snapshot 181acb66-4ab4-42f7-b928-b6c4071d9a26: creating. {{(pid=86384) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:06:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Creating offline snapshot 7a8811dd-1c79-498b-b5a7-8d843f75a47e of volume 2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd7ba8-a2f4-4a55-9005-9a13550f15f1]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:25 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b Sep 28 15:06:25 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:25 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b" returned: 0 in 0.582s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:25 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e 1G Sep 28 15:06:25 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:26 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e 1G" returned: 0 in 0.778s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7606e9-e14a-4516-93f7-cb07694e655b -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:26 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7606e9-e14a-4516-93f7-cb07694e655b -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e Sep 28 15:06:26 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:26 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7606e9-e14a-4516-93f7-cb07694e655b -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e" returned: 0 in 0.411s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:26 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:26 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e Sep 28 15:06:26 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:27 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e" returned: 0 in 0.578s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.info Sep 28 15:06:27 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:28 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.info" returned: 0 in 0.648s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:28 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.info Sep 28 15:06:28 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:28 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.info" returned: 0 in 0.561s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.750s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Creating offline snapshot 8570444e-d816-43cc-ad17-50bd913d4112 of volume f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0917ed6a-8b45-4524-a7db-76cc83bf5601]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 Sep 28 15:06:29 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:29 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158" returned: 0 in 0.900s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 1G Sep 28 15:06:29 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:30 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 1G" returned: 0 in 1.205s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e154ce-f90f-4179-a953-c24e45bc6158 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:31 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e154ce-f90f-4179-a953-c24e45bc6158 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 Sep 28 15:06:31 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:31 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e154ce-f90f-4179-a953-c24e45bc6158 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112" returned: 0 in 0.779s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:31 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:31 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 Sep 28 15:06:31 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:32 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112" returned: 0 in 0.780s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:32 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.info Sep 28 15:06:32 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:33 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.info" returned: 0 in 0.763s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:33 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:33 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.info Sep 28 15:06:33 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:33 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:06:33 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:34 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.info" returned: 0 in 1.120s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.791s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:34 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2bf37d93-a30d-48f5-9a1b-a48d20649398 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 181acb66-4ab4-42f7-b928-b6c4071d9a26: created successfully Sep 28 15:06:35 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 1.210s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:35 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:35 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 28 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:06:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:06:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 181acb66-4ab4-42f7-b928-b6c4071d9a26: deleting Sep 28 15:06:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 181acb66-4ab4-42f7-b928-b6c4071d9a26: deleting {{(pid=86384) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-2c7606e9-e14a-4516-93f7-cb07694e655b" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-2c7606e9-e14a-4516-93f7-cb07694e655b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-7a8811dd-1c79-498b-b5a7-8d843f75a47e" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-7a8811dd-1c79-498b-b5a7-8d843f75a47e" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Deleting offline snapshot 7a8811dd-1c79-498b-b5a7-8d843f75a47e of volume 2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] snapshot_file for this snap is: volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4994f5b-8c5d-48d7-9948-54397cd106f2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:36 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e Sep 28 15:06:36 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:37 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e" returned: 0 in 1.232s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c7606e9-e14a-4516-93f7-cb07694e655b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:37 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41bee2e-d43c-4cc2-b305-5c429293553e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:37 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b Sep 28 15:06:37 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:38 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b" returned: 0 in 0.972s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:38 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e Sep 28 15:06:38 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:39 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e" returned: 0 in 0.813s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:39 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e Sep 28 15:06:39 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:39 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b.7a8811dd-1c79-498b-b5a7-8d843f75a47e" returned: 0 in 0.633s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-7a8811dd-1c79-498b-b5a7-8d843f75a47e" released by "_delete_snapshot" :: held 3.921s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-2c7606e9-e14a-4516-93f7-cb07694e655b" released by "delete_snapshot" :: held 4.013s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-f0e154ce-f90f-4179-a953-c24e45bc6158" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-f0e154ce-f90f-4179-a953-c24e45bc6158" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-8570444e-d816-43cc-ad17-50bd913d4112" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (ed892fda-554a-4ceb-9cbe-7f625878e9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d187f5-198e-4b0e-a777-167ba9bb307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-8570444e-d816-43cc-ad17-50bd913d4112" acquired by "_delete_snapshot" :: waited 0.125s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Deleting offline snapshot 8570444e-d816-43cc-ad17-50bd913d4112 of volume f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] snapshot_file for this snap is: volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d187f5-198e-4b0e-a777-167ba9bb307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071824534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af04051-6f1c-44ec-aa75-fc09a3df0c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:40Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7963c088-0fb6-4c09-a3a6-50768cb10242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7963c088-0fb6-4c09-a3a6-50768cb10242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3da6a4-ba06-46eb-a550-d894b46a023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3da6a4-ba06-46eb-a550-d894b46a023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af04051-6f1c-44ec-aa75-fc09a3df0c9f', 'volume_name': 'volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822b0bc5-0593-4c82-ab8b-031d61804a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822b0bc5-0593-4c82-ab8b-031d61804a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9126518-cd0b-4bbc-b654-b1c3b6b5dfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:40 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Volume 2af04051-6f1c-44ec-aa75-fc09a3df0c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f', 'volume_size': 1} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071824534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af04051-6f1c-44ec-aa75-fc09a3df0c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:40Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Creating volume 2af04051-6f1c-44ec-aa75-fc09a3df0c9f {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:40 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a677ba-d589-45a3-83f1-1a83927b711f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:40 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f 1073741824 Sep 28 15:06:40 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:40 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 Sep 28 15:06:40 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:41 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112" returned: 0 in 0.929s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e154ce-f90f-4179-a953-c24e45bc6158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc777c1-b12f-4591-b663-6afcba30debf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:41 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f 1073741824" returned: 0 in 1.092s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:41 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f Sep 28 15:06:41 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:41 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 Sep 28 15:06:41 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:42 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" returned: 0 in 0.513s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9126518-cd0b-4bbc-b654-b1c3b6b5dfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56acf1bf-292d-4384-bd9d-9a5eb8b132c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Volume volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f (2af04051-6f1c-44ec-aa75-fc09a3df0c9f): created successfully Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56acf1bf-292d-4384-bd9d-9a5eb8b132c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (ed892fda-554a-4ceb-9cbe-7f625878e9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5f5a169e-f75a-4078-b4c9-ae5077dc4c95 tempest-VolumesActionsTest-841753568 None] Created volume successfully. Sep 28 15:06:42 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158" returned: 0 in 0.974s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:42 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 Sep 28 15:06:42 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-93dafcbf-edfd-46b2-b63f-82ad0aa07aeb tempest-VolumesActionsTest-841753568 None] Acquiring lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" by "attach_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-93dafcbf-edfd-46b2-b63f-82ad0aa07aeb tempest-VolumesActionsTest-841753568 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" acquired by "attach_volume" :: waited 0.087s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-93dafcbf-edfd-46b2-b63f-82ad0aa07aeb tempest-VolumesActionsTest-841753568 None] Attaching volume 2af04051-6f1c-44ec-aa75-fc09a3df0c9f to instance d2f3dd6a-b6c7-467d-acce-7434ad98c1b3 at mountpoint /dev/vdb on host None. Sep 28 15:06:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-93dafcbf-edfd-46b2-b63f-82ad0aa07aeb tempest-VolumesActionsTest-841753568 None] Attach volume completed successfully. Sep 28 15:06:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-93dafcbf-edfd-46b2-b63f-82ad0aa07aeb tempest-VolumesActionsTest-841753568 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" released by "attach_volume" :: held 0.273s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:43 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112" returned: 0 in 1.053s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:43 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112 Sep 28 15:06:43 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:44 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158.8570444e-d816-43cc-ad17-50bd913d4112" returned: 0 in 0.587s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-8570444e-d816-43cc-ad17-50bd913d4112" released by "_delete_snapshot" :: held 3.901s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-f0e154ce-f90f-4179-a953-c24e45bc6158" released by "delete_snapshot" :: held 4.041s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c679dbba-3540-4785-a34a-41211b009b01 tempest-VolumesActionsTest-1333176859 None] Terminate volume connection completed successfully. Sep 28 15:06:44 devstack cinder-volume[86384]: WARNING cinder.quota [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2108044751 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2108044751, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:44 devstack cinder-volume[86384]: WARNING cinder.quota [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2108044751 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2108044751, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c679dbba-3540-4785-a34a-41211b009b01 tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-detach_volume" by "detach_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c679dbba-3540-4785-a34a-41211b009b01 tempest-VolumesActionsTest-1333176859 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['6ad5351f-b9cf-419e-80d8-4e6dc53f4aa4', 'ac5e4823-d402-4c35-9eae-463159d63c08', 'ef086eff-2b03-4404-9375-8e94d01c5216', 'ecc87c39-7bbe-47cf-a6e8-9a1d51b6078f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c679dbba-3540-4785-a34a-41211b009b01 tempest-VolumesActionsTest-1333176859 None] Detaching volume 2af04051-6f1c-44ec-aa75-fc09a3df0c9f from instance d2f3dd6a-b6c7-467d-acce-7434ad98c1b3. Sep 28 15:06:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c679dbba-3540-4785-a34a-41211b009b01 tempest-VolumesActionsTest-1333176859 None] Detach volume completed successfully. Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c679dbba-3540-4785-a34a-41211b009b01 tempest-VolumesActionsTest-1333176859 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-detach_volume" released by "detach_volume" :: held 0.202s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['a952c9c2-dd86-44b4-a16e-e5b248d1ba3c', '5580d05f-33f8-4a91-9340-7521423349df', '6c20c72a-bfeb-4b8f-a935-f039f5a2fd3e', '031cfe2e-8275-4e04-a64d-e7e06dd35eb0'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-54261cdb-09d8-48a6-9099-b098ed34db22 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 181acb66-4ab4-42f7-b928-b6c4071d9a26: deleted successfully Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0bfc13b9-4208-48ee-99c6-af740bf6fcf2 tempest-VolumesActionsTest-841753568 None] Acquiring lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-detach_volume" by "detach_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0bfc13b9-4208-48ee-99c6-af740bf6fcf2 tempest-VolumesActionsTest-841753568 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0bfc13b9-4208-48ee-99c6-af740bf6fcf2 tempest-VolumesActionsTest-841753568 None] Volume detach called, but volume not attached. Sep 28 15:06:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0bfc13b9-4208-48ee-99c6-af740bf6fcf2 tempest-VolumesActionsTest-841753568 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-detach_volume" released by "detach_volume" :: held 0.017s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Acquiring lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Acquiring lock "cinder-quobyte-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Lock "cinder-quobyte-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:45 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafec643-74d3-4848-9d60-92e30cb452ae]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:45 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f Sep 28 15:06:45 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:46 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" returned: 0 in 0.508s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:46 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f Sep 28 15:06:46 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-2c7606e9-e14a-4516-93f7-cb07694e655b" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:46 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" returned: 0 in 0.484s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Lock "cinder-quobyte-2af04051-6f1c-44ec-aa75-fc09a3df0c9f" released by "delete_volume" :: held 1.084s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-2c7606e9-e14a-4516-93f7-cb07694e655b" acquired by "delete_volume" :: waited 0.092s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a6389-3e63-4b7e-b9bf-56af3f890559]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Created reservations ['ee3942ff-ecb5-401b-83e4-62871f9c752b', 'd97e9166-12e7-4fb2-847a-1470d0bf6232', '490ad160-c456-4779-acfa-6f19bed9b67b', 'ab6cf71c-8905-4e5f-9391-6d03e6c99050'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:46 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:46 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:46 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:06:46 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:47 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.331s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Deleted volume successfully. Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-887e0f78-a6ef-477b-a9f5-4420264bb7d9 tempest-VolumesActionsTest-841753568 None] Lock "cinder-2af04051-6f1c-44ec-aa75-fc09a3df0c9f-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:47 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b" returned: 0 in 0.664s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:47 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b Sep 28 15:06:47 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:47 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2c7606e9-e14a-4516-93f7-cb07694e655b" returned: 0 in 0.340s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-2c7606e9-e14a-4516-93f7-cb07694e655b" released by "delete_volume" :: held 1.187s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-f0e154ce-f90f-4179-a953-c24e45bc6158" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-f0e154ce-f90f-4179-a953-c24e45bc6158" acquired by "delete_volume" :: waited 0.056s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[67862a1a-4397-4d55-82e2-f10b3af4cdd2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:48 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 Sep 28 15:06:48 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:49 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158" returned: 0 in 1.061s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:49 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158 Sep 28 15:06:49 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:49 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f0e154ce-f90f-4179-a953-c24e45bc6158" returned: 0 in 0.684s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-f0e154ce-f90f-4179-a953-c24e45bc6158" released by "delete_volume" :: held 1.996s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:49 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['58a976e9-18c6-49b6-9731-438ad3dd50af'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:50 devstack cinder-volume[86384]: WARNING cinder.quota [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2108044751 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2108044751, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['8875deb6-ed0a-45cc-9ba1-04705c49714c', 'ce9f830a-3986-4f78-8c7b-bc0ed089f06f', '4bb0cdd4-8a6e-46e1-bca5-c4830e2bacf5', '929620b7-7bc0-4ade-8d0e-99416cb80bef'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['8041df0e-9d0e-4ba1-bef8-136542d78586', '6c0adfa6-62db-4a40-935e-11d599522cf4', '4a95e0d6-f1e2-4c5c-ab5b-d48b0a82db72', 'd15a24f7-922c-441f-aa11-cff93b472a1f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:50 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:06:50 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:51 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.763s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:51 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-eaf9adbc-cf66-428b-98e0-cba9d9fc4f16 tempest-GroupSnapshotsTest-345363750 None] Delete group completed successfully. Sep 28 15:06:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fd960502-c399-4a44-b7a3-a7e933dbfc17 tempest-GroupSnapshotsTest-345363750 None] Group tempest-GroupSnapshotsTest-Group-528651609: creating Sep 28 15:06:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fd960502-c399-4a44-b7a3-a7e933dbfc17 tempest-GroupSnapshotsTest-345363750 None] Group tempest-GroupSnapshotsTest-Group-528651609: created successfully Sep 28 15:06:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fd960502-c399-4a44-b7a3-a7e933dbfc17 tempest-GroupSnapshotsTest-345363750 None] Create group completed successfully. Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (b6370dfb-9a7b-415d-9f24-2f23a22ea1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7ca89d-5062-403f-b0c2-196b9fc8c57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (4412f837-79d1-45b3-81db-1242a782b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc558e3-7567-4223-9ae4-4df8c12ad04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7ca89d-5062-403f-b0c2-196b9fc8c57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1047722055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f2fbe5-d416-4621-9b53-edd5dd6c103f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:55Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a39443-1b07-49ef-975e-34302f0f656d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a39443-1b07-49ef-975e-34302f0f656d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c3813d-75cc-4fee-b9c2-9ca6d124a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c3813d-75cc-4fee-b9c2-9ca6d124a376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f2fbe5-d416-4621-9b53-edd5dd6c103f', 'volume_name': 'volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a0dd15-33cd-4c25-bcc2-e9a75aefa1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a0dd15-33cd-4c25-bcc2-e9a75aefa1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09320ab-596d-4d87-b060-d5e50803c75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Volume d2f2fbe5-d416-4621-9b53-edd5dd6c103f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f', 'volume_size': 1} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1047722055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f2fbe5-d416-4621-9b53-edd5dd6c103f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:55Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Creating volume d2f2fbe5-d416-4621-9b53-edd5dd6c103f {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:54 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc558e3-7567-4223-9ae4-4df8c12ad04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1929324317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=086b880b-9da4-4892-9183-944c7cd11f0a,host='devstack@QuobyteHD#QuobyteHD',id=697f7a68-015d-497c-92e7-d623a5f865ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:55Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec113cf5-dfe9-4c1f-b690-2cc3fd3c7503),volume_type_id=ec113cf5-dfe9-4c1f-b690-2cc3fd3c7503)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f 1073741824 Sep 28 15:06:54 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa46fa5c-17e7-45f5-8456-1e70cd4063cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa46fa5c-17e7-45f5-8456-1e70cd4063cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3567ec3c-9d37-475e-964e-212256092a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3567ec3c-9d37-475e-964e-212256092a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697f7a68-015d-497c-92e7-d623a5f865ef', 'volume_name': 'volume-697f7a68-015d-497c-92e7-d623a5f865ef', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be2f130-a557-46c1-a47b-6055e0d388d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be2f130-a557-46c1-a47b-6055e0d388d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb00ff3-084c-4b3c-9d00-d7bf20ff8283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:54 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Volume 697f7a68-015d-497c-92e7-d623a5f865ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697f7a68-015d-497c-92e7-d623a5f865ef', 'volume_size': 1} Sep 28 15:06:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:55 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f 1073741824" returned: 0 in 0.559s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f Sep 28 15:06:55 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f" returned: 0 in 0.278s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=086b880b-9da4-4892-9183-944c7cd11f0a,created_at=2026-09-28T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1929324317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=086b880b-9da4-4892-9183-944c7cd11f0a,host='devstack@QuobyteHD#QuobyteHD',id=697f7a68-015d-497c-92e7-d623a5f865ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03caa94caab9489aa5f651879ed6d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:55Z,use_quota=True,user_id='6751986bb82f44daaf87fb780d28748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec113cf5-dfe9-4c1f-b690-2cc3fd3c7503),volume_type_id=ec113cf5-dfe9-4c1f-b690-2cc3fd3c7503)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Creating volume 697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:55 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09320ab-596d-4d87-b060-d5e50803c75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e192d90-a2fe-4e8d-ac22-69055ba7069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:55 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef 1073741824 Sep 28 15:06:55 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Volume volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f (d2f2fbe5-d416-4621-9b53-edd5dd6c103f): created successfully Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e192d90-a2fe-4e8d-ac22-69055ba7069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (b6370dfb-9a7b-415d-9f24-2f23a22ea1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5af988a1-74a3-4356-aaee-919bc1367f80 tempest-VolumesActionsTest-841753568 None] Created volume successfully. Sep 28 15:06:56 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef 1073741824" returned: 0 in 0.575s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef Sep 28 15:06:56 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef" returned: 0 in 0.348s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb00ff3-084c-4b3c-9d00-d7bf20ff8283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697f7a68-015d-497c-92e7-d623a5f865ef', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bade129-1201-47d4-9dc2-5bd4037d21a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-d2f2fbe5-d416-4621-9b53-edd5dd6c103f-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:56 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Volume volume-697f7a68-015d-497c-92e7-d623a5f865ef (697f7a68-015d-497c-92e7-d623a5f865ef): created successfully Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bade129-1201-47d4-9dc2-5bd4037d21a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Flow 'volume_create_manager' (4412f837-79d1-45b3-81db-1242a782b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Lock "cinder-d2f2fbe5-d416-4621-9b53-edd5dd6c103f-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-31292b65-49e5-40d5-ab56-64da6c6425d0 tempest-GroupSnapshotsTest-345363750 None] Created volume successfully. Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-quobyte-d2f2fbe5-d416-4621-9b53-edd5dd6c103f" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-d2f2fbe5-d416-4621-9b53-edd5dd6c103f" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7fac58-36c8-4909-9e8a-b0636a4ddecf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Flow 'volume_create_manager' (dfdbebe5-2689-4b7e-84eb-cb4b5637b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3699250e-013b-4319-b9f4-63d6e0950bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:57 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f Sep 28 15:06:57 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3699250e-013b-4319-b9f4-63d6e0950bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-197939279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf10a86b-904f-4712-bc21-9c15b2835deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26245695e2784bda8a296547b7f89a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:57Z,use_quota=True,user_id='f2219e739e9347d0b78c5f44278500c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4dc25d-dd02-48c5-93dc-c4644e6ed610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4dc25d-dd02-48c5-93dc-c4644e6ed610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f2635a-e3e4-44c0-88c2-e28d1d6f0667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f2635a-e3e4-44c0-88c2-e28d1d6f0667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf10a86b-904f-4712-bc21-9c15b2835deb', 'volume_name': 'volume-cf10a86b-904f-4712-bc21-9c15b2835deb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20fdf26-6287-451f-9e16-09fc9b9422ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20fdf26-6287-451f-9e16-09fc9b9422ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6839594-cf62-44ca-94a0-4bb7410153bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Volume cf10a86b-904f-4712-bc21-9c15b2835deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf10a86b-904f-4712-bc21-9c15b2835deb', 'volume_size': 1} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-197939279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf10a86b-904f-4712-bc21-9c15b2835deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26245695e2784bda8a296547b7f89a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:57Z,use_quota=True,user_id='f2219e739e9347d0b78c5f44278500c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Creating volume cf10a86b-904f-4712-bc21-9c15b2835deb {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:57 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb 1073741824 Sep 28 15:06:57 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f" returned: 0 in 0.425s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f Sep 28 15:06:57 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb 1073741824" returned: 0 in 0.479s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:INSERT=20,cinder:UPDATE=100,cinder:SELECT=97,cinder:DELETE=5 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=95,cinder:UPDATE=97,cinder:INSERT=25,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:57 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d2f2fbe5-d416-4621-9b53-edd5dd6c103f" returned: 0 in 0.326s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-d2f2fbe5-d416-4621-9b53-edd5dd6c103f" released by "delete_volume" :: held 0.825s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:57 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb Sep 28 15:06:57 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Created reservations ['5bf270e8-3d21-439e-9414-2a09336267f3', '7b8dac4d-abeb-4776-b7f5-566a94c91cdb', 'c2e62b23-be7f-47dc-b454-e116976755a5', 'f6d27a73-1190-45fa-8ccc-91d27d2f8668'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:06:58 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb" returned: 0 in 0.486s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:58 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.305s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6839594-cf62-44ca-94a0-4bb7410153bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf10a86b-904f-4712-bc21-9c15b2835deb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62479ef9-2e30-4bda-be71-65dbe1495fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Deleted volume successfully. Sep 28 15:06:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Volume volume-cf10a86b-904f-4712-bc21-9c15b2835deb (cf10a86b-904f-4712-bc21-9c15b2835deb): created successfully Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62479ef9-2e30-4bda-be71-65dbe1495fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Flow 'volume_create_manager' (dfdbebe5-2689-4b7e-84eb-cb4b5637b891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-53f6c3d2-f41e-42a1-a086-ec0a8b8bce92 tempest-AttachVolumeNegativeTest-760384332 None] Created volume successfully. Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-54f5e508-1851-4733-83a7-4506241c6262 tempest-VolumesActionsTest-1333176859 None] Lock "cinder-d2f2fbe5-d416-4621-9b53-edd5dd6c103f-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] GroupSnapshot 46053de6-589f-4e02-92b9-c1be3fe0965b: creating. Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Group snapshot 46053de6-589f-4e02-92b9-c1be3fe0965b: creating. {{(pid=86384) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Creating offline snapshot bce4a174-4f55-4545-9ad1-555124c11177 of volume 697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590e079-4672-48c7-9ab5-16bfd7b433ff]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef Sep 28 15:06:58 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:59 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef" returned: 0 in 0.459s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:59 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 1G Sep 28 15:06:59 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (1b275b80-88f9-4d13-8905-15fc28d745cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632613ce-a2dd-475e-9e67-a187e5f527c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632613ce-a2dd-475e-9e67-a187e5f527c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743684518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b39a4f-f51e-4b75-9a97-f21ff947aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:59Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ae375c-eed0-4136-9847-00846bc2ddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ae375c-eed0-4136-9847-00846bc2ddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b317c54-e7de-4773-9e02-af9a0650af30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b317c54-e7de-4773-9e02-af9a0650af30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b39a4f-f51e-4b75-9a97-f21ff947aefb', 'volume_name': 'volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2316a51-bfa5-49cf-a17f-03db19d17e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2316a51-bfa5-49cf-a17f-03db19d17e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3c7cc5-9b20-4dc4-b62c-ed3482b0575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Volume 15b39a4f-f51e-4b75-9a97-f21ff947aefb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb', 'volume_size': 1} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:59 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 1G" returned: 0 in 0.600s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697f7a68-015d-497c-92e7-d623a5f865ef -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:59 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697f7a68-015d-497c-92e7-d623a5f865ef -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 Sep 28 15:06:59 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-503560c8-e552-41f6-96d3-239589765413 req-8f635cd6-e980-4f6d-bdaf-b757b4b032f5 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:00 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697f7a68-015d-497c-92e7-d623a5f865ef -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177" returned: 0 in 0.542s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:00 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:00 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 Sep 28 15:07:00 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:00 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177" returned: 0 in 0.318s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:00 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.info Sep 28 15:07:00 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:00 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.info" returned: 0 in 0.293s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:00 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:07:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:00 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.info Sep 28 15:07:00 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:01 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.info" returned: 0 in 0.275s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743684518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b39a4f-f51e-4b75-9a97-f21ff947aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:59Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Creating volume 15b39a4f-f51e-4b75-9a97-f21ff947aefb {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:01 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb 1073741824 Sep 28 15:07:01 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9563e7d1-761b-4448-92c2-37f43492d497 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 46053de6-589f-4e02-92b9-c1be3fe0965b: created successfully Sep 28 15:07:01 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb 1073741824" returned: 0 in 0.570s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:01 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb Sep 28 15:07:01 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 46053de6-589f-4e02-92b9-c1be3fe0965b: deleting Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 46053de6-589f-4e02-92b9-c1be3fe0965b: deleting {{(pid=86384) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-697f7a68-015d-497c-92e7-d623a5f865ef" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-697f7a68-015d-497c-92e7-d623a5f865ef" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-bce4a174-4f55-4545-9ad1-555124c11177" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-bce4a174-4f55-4545-9ad1-555124c11177" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Deleting offline snapshot bce4a174-4f55-4545-9ad1-555124c11177 of volume 697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] snapshot_file for this snap is: volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1177c8-ba3d-4f6c-a615-4e525cf6ce0f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:02 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb" returned: 0 in 0.534s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-503560c8-e552-41f6-96d3-239589765413 req-8f635cd6-e980-4f6d-bdaf-b757b4b032f5 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.220s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3c7cc5-9b20-4dc4-b62c-ed3482b0575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2773676-8e08-41dc-be54-1433ddfc43d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-503560c8-e552-41f6-96d3-239589765413 req-8f635cd6-e980-4f6d-bdaf-b757b4b032f5 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Volume volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb (15b39a4f-f51e-4b75-9a97-f21ff947aefb): created successfully Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2773676-8e08-41dc-be54-1433ddfc43d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (1b275b80-88f9-4d13-8905-15fc28d745cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b285a513-8bd2-4fd0-81fa-dd645afd3520 tempest-VolumesActionsTest-841753568 None] Created volume successfully. Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-503560c8-e552-41f6-96d3-239589765413 req-8f635cd6-e980-4f6d-bdaf-b757b4b032f5 tempest-AttachVolumeNegativeTest-760384332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-cf10a86b-904f-4712-bc21-9c15b2835deb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0af1a08a-4dd1-40fe-8611-56ff571044d1', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:02 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 Sep 28 15:07:02 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-503560c8-e552-41f6-96d3-239589765413 req-8f635cd6-e980-4f6d-bdaf-b757b4b032f5 tempest-AttachVolumeNegativeTest-760384332 None] attachment_update completed successfully. Sep 28 15:07:02 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177" returned: 0 in 0.575s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697f7a68-015d-497c-92e7-d623a5f865ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb336c87-cc1d-438f-aeab-10b7969830f9]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:03 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef Sep 28 15:07:03 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:03 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef" returned: 0 in 0.521s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:03 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 Sep 28 15:07:03 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-15b39a4f-f51e-4b75-9a97-f21ff947aefb-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Lock "cinder-15b39a4f-f51e-4b75-9a97-f21ff947aefb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-quobyte-15b39a4f-f51e-4b75-9a97-f21ff947aefb" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-15b39a4f-f51e-4b75-9a97-f21ff947aefb" acquired by "delete_volume" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd09ace9-115a-4ce0-9d28-339ed37638fe]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:04 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177" returned: 0 in 0.514s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:04 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177 Sep 28 15:07:04 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:04 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb Sep 28 15:07:04 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:04 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef.bce4a174-4f55-4545-9ad1-555124c11177" returned: 0 in 0.350s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-bce4a174-4f55-4545-9ad1-555124c11177" released by "_delete_snapshot" :: held 2.170s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-697f7a68-015d-497c-92e7-d623a5f865ef" released by "delete_snapshot" :: held 2.233s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:04 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb" returned: 0 in 0.516s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:04 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb Sep 28 15:07:04 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:04 devstack cinder-volume[86384]: WARNING cinder.quota [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1771669238 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1771669238, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:04 devstack cinder-volume[86384]: WARNING cinder.quota [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1771669238 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1771669238, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['fad73d1a-cf3d-4f84-adaa-bf457190c286', 'd4187b1c-699a-4e03-a661-514ddfa38b05', '4f8b2d98-f68d-4a8d-8ff7-3fa0fb900bae', '138b5cc1-ef5e-4f04-8ba1-1ba2338e8731'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5421b562-f84a-47af-a6ea-37c24cc9b040 tempest-GroupSnapshotsTest-345363750 None] group_snapshot 46053de6-589f-4e02-92b9-c1be3fe0965b: deleted successfully Sep 28 15:07:04 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-15b39a4f-f51e-4b75-9a97-f21ff947aefb" returned: 0 in 0.345s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-15b39a4f-f51e-4b75-9a97-f21ff947aefb" released by "delete_volume" :: held 0.909s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:04 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Created reservations ['3506a02a-4098-4ce3-8cce-f64af3693269', '3f034cac-02f4-4ad3-803d-b2f1fb1a1e4e', '591b5fa1-9615-4817-8c0f-5bee4c97b3a8', '4cc82884-2322-4fdb-813f-4e59439a7599'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:05 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:07:05 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:05 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.290s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Deleted volume successfully. Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b5be6b4c-89b3-41a7-bdee-d71e650769cb tempest-VolumesActionsTest-1333176859 None] Lock "cinder-15b39a4f-f51e-4b75-9a97-f21ff947aefb-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-3da87de3-13a2-4c42-8967-552b907e2947 req-df731ee4-74d2-4f2f-b154-504aba642d2d tempest-AttachVolumeNegativeTest-760384332 None] Terminate volume connection completed successfully. Sep 28 15:07:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-3da87de3-13a2-4c42-8967-552b907e2947 req-df731ee4-74d2-4f2f-b154-504aba642d2d tempest-AttachVolumeNegativeTest-760384332 None] Deleting attachment 0af1a08a-4dd1-40fe-8611-56ff571044d1. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "cinder-quobyte-697f7a68-015d-497c-92e7-d623a5f865ef" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-697f7a68-015d-497c-92e7-d623a5f865ef" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5704bf2c-e002-4a52-84dd-1256de16416a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:06 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef Sep 28 15:07:06 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:06 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef" returned: 0 in 0.567s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:06 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef Sep 28 15:07:06 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (7085ee92-6c19-4258-8554-8afa916f9a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e60428-4380-40c3-87e3-5ac101a0ea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e60428-4380-40c3-87e3-5ac101a0ea69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791222726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5feec19-4d4e-47d2-82e3-4f993b850a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:07Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca91a7b-a55d-44bf-8896-809d84dd3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca91a7b-a55d-44bf-8896-809d84dd3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f83232f-5e4d-4ac8-b0a6-3a3ef9d185da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f83232f-5e4d-4ac8-b0a6-3a3ef9d185da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5feec19-4d4e-47d2-82e3-4f993b850a71', 'volume_name': 'volume-a5feec19-4d4e-47d2-82e3-4f993b850a71', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555a3e96-5fd0-4323-a43a-297780200e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555a3e96-5fd0-4323-a43a-297780200e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079057bd-bfed-4d11-8139-69e08cc5e325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Volume a5feec19-4d4e-47d2-82e3-4f993b850a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5feec19-4d4e-47d2-82e3-4f993b850a71', 'volume_size': 1} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791222726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5feec19-4d4e-47d2-82e3-4f993b850a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:07Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Creating volume a5feec19-4d4e-47d2-82e3-4f993b850a71 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:06 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:07 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 1073741824 Sep 28 15:07:07 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:07 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-697f7a68-015d-497c-92e7-d623a5f865ef" returned: 0 in 0.474s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Lock "cinder-quobyte-697f7a68-015d-497c-92e7-d623a5f865ef" released by "delete_volume" :: held 1.184s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['fcb0d90e-ed63-4e31-a98f-a9bfc628b6f3'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:07 devstack cinder-volume[86384]: WARNING cinder.quota [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1771669238 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1771669238, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Created reservations ['d05db787-8529-4b56-871d-fe4dc0908898', 'a4064563-b857-4dfb-9e87-b90452557c33', 'f6d9ec78-5ad8-46c7-a1fe-48aa0f27b7da', 'a93376e0-e44f-465a-8860-a9140cd5d1a4'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:07 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:07:07 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:07 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 1073741824" returned: 0 in 0.843s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:07 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 Sep 28 15:07:07 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:07 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.338s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:07 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:07 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-296eb5d2-1d22-4d68-a38e-af5198029f99 tempest-GroupSnapshotsTest-345363750 None] Delete group completed successfully. Sep 28 15:07:08 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71" returned: 0 in 0.318s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079057bd-bfed-4d11-8139-69e08cc5e325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5feec19-4d4e-47d2-82e3-4f993b850a71', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12085b4b-3029-452d-97a2-377ef16dce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Volume volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 (a5feec19-4d4e-47d2-82e3-4f993b850a71): created successfully Sep 28 15:07:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12085b4b-3029-452d-97a2-377ef16dce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (7085ee92-6c19-4258-8554-8afa916f9a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9a191d90-b122-4d6c-a33d-1cc856a0f31b tempest-VolumesActionsTest-841753568 None] Created volume successfully. Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-a5feec19-4d4e-47d2-82e3-4f993b850a71-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Lock "cinder-a5feec19-4d4e-47d2-82e3-4f993b850a71-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-quobyte-a5feec19-4d4e-47d2-82e3-4f993b850a71" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-a5feec19-4d4e-47d2-82e3-4f993b850a71" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d775fd3e-8b4a-4161-95bb-4ec2af64db33]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:09 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 Sep 28 15:07:09 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:09 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71" returned: 0 in 0.536s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:09 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71 Sep 28 15:07:09 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:10 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a5feec19-4d4e-47d2-82e3-4f993b850a71" returned: 0 in 0.290s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-a5feec19-4d4e-47d2-82e3-4f993b850a71" released by "delete_volume" :: held 0.903s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Created reservations ['e6094485-3b19-4ac1-a499-811d4186982d', '421f6732-a198-44d9-931f-0506d4e6b75d', '6c3d2888-db35-45ed-a6b8-f83090fbf94b', '27795ecb-ccb3-4027-8dc1-043d5d131562'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:10 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:07:10 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:10 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Deleted volume successfully. Sep 28 15:07:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fec98516-dbcd-4787-8154-b4bf012388bf tempest-VolumesActionsTest-1333176859 None] Lock "cinder-a5feec19-4d4e-47d2-82e3-4f993b850a71-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (c0797aa7-dda0-44d2-875c-077bc0a91192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506293e4-dc7e-4b5d-97a5-0dc3c8432a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506293e4-dc7e-4b5d-97a5-0dc3c8432a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043480836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d38da27-6b17-40ac-ab53-072dfd4d0197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:11Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0678fc38-c8ae-4bb7-93e2-1f6a8e200a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0678fc38-c8ae-4bb7-93e2-1f6a8e200a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade04dfb-4053-42f3-8b60-bd1e36430f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade04dfb-4053-42f3-8b60-bd1e36430f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d38da27-6b17-40ac-ab53-072dfd4d0197', 'volume_name': 'volume-9d38da27-6b17-40ac-ab53-072dfd4d0197', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07520b6-34ec-4350-9116-975bac1056d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07520b6-34ec-4350-9116-975bac1056d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9c9332-77c4-4c4d-b089-4099c512b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Volume 9d38da27-6b17-40ac-ab53-072dfd4d0197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d38da27-6b17-40ac-ab53-072dfd4d0197', 'volume_size': 1} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043480836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d38da27-6b17-40ac-ab53-072dfd4d0197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:11Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Creating volume 9d38da27-6b17-40ac-ab53-072dfd4d0197 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:11 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:11 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 1073741824 Sep 28 15:07:11 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:12 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 1073741824" returned: 0 in 0.740s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:12 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 Sep 28 15:07:12 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:12 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197" returned: 0 in 0.447s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9c9332-77c4-4c4d-b089-4099c512b21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d38da27-6b17-40ac-ab53-072dfd4d0197', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b411c0-6298-4266-9b76-e66605c1e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Volume volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 (9d38da27-6b17-40ac-ab53-072dfd4d0197): created successfully Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b411c0-6298-4266-9b76-e66605c1e453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (c0797aa7-dda0-44d2-875c-077bc0a91192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d4ca9bdf-dd61-4765-9df6-18742e5966d6 tempest-VolumesActionsTest-841753568 None] Created volume successfully. Sep 28 15:07:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-9d38da27-6b17-40ac-ab53-072dfd4d0197-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Lock "cinder-9d38da27-6b17-40ac-ab53-072dfd4d0197-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Acquiring lock "cinder-quobyte-9d38da27-6b17-40ac-ab53-072dfd4d0197" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-9d38da27-6b17-40ac-ab53-072dfd4d0197" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25ba50-f7f5-4c4a-970b-7b238dc38cca]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:13 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 Sep 28 15:07:13 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:14 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197" returned: 0 in 0.541s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:14 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197 Sep 28 15:07:14 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:14 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9d38da27-6b17-40ac-ab53-072dfd4d0197" returned: 0 in 0.488s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Lock "cinder-quobyte-9d38da27-6b17-40ac-ab53-072dfd4d0197" released by "delete_volume" :: held 1.103s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Created reservations ['6b1c5533-1691-43a8-95f7-54c7f8d9fad4', 'f6cb7c87-b983-45a5-bead-28a45838c0ac', 'ca16ca33-609b-48ea-8af3-2aaa26814c26', 'eb7e66da-2a12-45b9-8a7b-b749a71f00b8'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:15 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:07:15 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Flow 'volume_create_manager' (52097612-ab62-4223-8ca7-5701442e909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9835b5c-9143-44ad-aa13-762dfe3c9443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9835b5c-9143-44ad-aa13-762dfe3c9443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-201456729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c84d30-94f0-4f92-a91e-6891f394e683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7884389a75574d4893fc96bc184b91b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:15Z,use_quota=True,user_id='b20f66fd50fa4f4dbb9a35c34d88fa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949d02d5-a66d-466e-8a53-99653aad8090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949d02d5-a66d-466e-8a53-99653aad8090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6d5941-402f-481f-af2a-4f1db04b51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6d5941-402f-481f-af2a-4f1db04b51f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c84d30-94f0-4f92-a91e-6891f394e683', 'volume_name': 'volume-60c84d30-94f0-4f92-a91e-6891f394e683', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acfcad7-a621-4fd1-93c4-ffddd6b4e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acfcad7-a621-4fd1-93c4-ffddd6b4e664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4de8fe6-b805-47d1-8158-52423326f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:15 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Volume 60c84d30-94f0-4f92-a91e-6891f394e683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c84d30-94f0-4f92-a91e-6891f394e683', 'volume_size': 1} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-201456729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c84d30-94f0-4f92-a91e-6891f394e683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7884389a75574d4893fc96bc184b91b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:15Z,use_quota=True,user_id='b20f66fd50fa4f4dbb9a35c34d88fa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Creating volume 60c84d30-94f0-4f92-a91e-6891f394e683 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:15 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:15 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 1073741824 Sep 28 15:07:15 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:15 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.436s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Deleted volume successfully. Sep 28 15:07:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d907f3a8-f6d0-486d-9bfa-26733b67d98b tempest-VolumesActionsTest-1333176859 None] Lock "cinder-9d38da27-6b17-40ac-ab53-072dfd4d0197-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:16 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 1073741824" returned: 0 in 0.749s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 Sep 28 15:07:16 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683" returned: 0 in 0.346s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4de8fe6-b805-47d1-8158-52423326f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c84d30-94f0-4f92-a91e-6891f394e683', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68967749-dec5-41d8-8524-475ed0b167d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Volume volume-60c84d30-94f0-4f92-a91e-6891f394e683 (60c84d30-94f0-4f92-a91e-6891f394e683): created successfully Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68967749-dec5-41d8-8524-475ed0b167d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Flow 'volume_create_manager' (52097612-ab62-4223-8ca7-5701442e909f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bcee04b7-4bd3-4a22-b931-ae563d6bf80a tempest-AttachVolumeShelveTestJSON-1660949402 None] Created volume successfully. Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (3ce54a8d-4ad6-4ebf-8ce3-ba902120f1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd239f48-aefc-478c-a157-c6aeed50c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd239f48-aefc-478c-a157-c6aeed50c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246127066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac555da-5959-40bf-9ca5-b3ff38e3b849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:17Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f8796-244b-4ea1-a378-433933a78f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f8796-244b-4ea1-a378-433933a78f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e941cd1-b6c3-45e2-bc65-a1bac9644382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e941cd1-b6c3-45e2-bc65-a1bac9644382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac555da-5959-40bf-9ca5-b3ff38e3b849', 'volume_name': 'volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa13f73-25a7-4219-9912-8d52bccd67f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa13f73-25a7-4219-9912-8d52bccd67f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5fbcf0-cb6d-46c5-ab42-72a55bb4cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Volume 0ac555da-5959-40bf-9ca5-b3ff38e3b849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849', 'volume_size': 1} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246127066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac555da-5959-40bf-9ca5-b3ff38e3b849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262d1028a4214ac380d6cb9da07c6d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:17Z,use_quota=True,user_id='7f112f5c25e34f869016a063393ca9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Creating volume 0ac555da-5959-40bf-9ca5-b3ff38e3b849 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:16 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 1073741824 Sep 28 15:07:16 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:17 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 1073741824" returned: 0 in 0.652s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:17 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 Sep 28 15:07:17 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:18 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849" returned: 0 in 0.362s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5fbcf0-cb6d-46c5-ab42-72a55bb4cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3b5e1-8be3-432e-b6c2-be1de89a0c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:18 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Volume volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 (0ac555da-5959-40bf-9ca5-b3ff38e3b849): created successfully Sep 28 15:07:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3b5e1-8be3-432e-b6c2-be1de89a0c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Flow 'volume_create_manager' (3ce54a8d-4ad6-4ebf-8ce3-ba902120f1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-17cd1a43-e943-40a8-8498-bf7e355243c7 tempest-VolumesActionsTest-841753568 None] Created volume successfully. Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Acquiring lock "cinder-0ac555da-5959-40bf-9ca5-b3ff38e3b849-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Lock "cinder-0ac555da-5959-40bf-9ca5-b3ff38e3b849-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Acquiring lock "cinder-quobyte-0ac555da-5959-40bf-9ca5-b3ff38e3b849" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Lock "cinder-quobyte-0ac555da-5959-40bf-9ca5-b3ff38e3b849" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c5daf9-4a05-40ac-894e-a1e216081377]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:20 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 Sep 28 15:07:20 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:20 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849" returned: 0 in 0.598s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:20 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849 Sep 28 15:07:20 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:21 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0ac555da-5959-40bf-9ca5-b3ff38e3b849" returned: 0 in 0.372s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Lock "cinder-quobyte-0ac555da-5959-40bf-9ca5-b3ff38e3b849" released by "delete_volume" :: held 1.053s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Created reservations ['723cfe90-f0e4-40cd-8836-0992053b0f92', '81b590b5-e2cd-4757-b306-bdac7d375e18', 'ca1163e4-43b0-4565-8c60-89857945cb44', 'd774c0eb-8d95-42c0-8e69-ca9cc42d3b08'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:21 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:07:21 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:22 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:22 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:22 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Deleted volume successfully. Sep 28 15:07:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d361a66-e1cf-4942-92ed-beac0d1325c3 tempest-VolumesActionsTest-841753568 None] Lock "cinder-0ac555da-5959-40bf-9ca5-b3ff38e3b849-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:31 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:INSERT=19,cinder:UPDATE=77,cinder:SELECT=56,cinder:DELETE=5 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:32 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=70,cinder:INSERT=17,cinder:UPDATE=77,cinder:DELETE=6 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:33 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:07:33 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:34 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.508s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 28 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:07:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:07:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-8e133c8a-5386-424b-9469-16619388472e req-f01f43b5-5ed2-4ddf-9391-3b9bc47095ff tempest-AttachVolumeShelveTestJSON-1660949402 None] No connector for attachment 7aed6e86-130d-4d16-ad3e-5eee66a48a1f; skipping storage backend terminate_connection call. {{(pid=86384) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 15:07:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-8e133c8a-5386-424b-9469-16619388472e req-f01f43b5-5ed2-4ddf-9391-3b9bc47095ff tempest-AttachVolumeShelveTestJSON-1660949402 None] Deleting attachment 7aed6e86-130d-4d16-ad3e-5eee66a48a1f. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:07:47 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Flow 'volume_create_manager' (cd841b06-fd2a-4b6c-ba10-0cb551f96ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ce590f-c66d-4685-8dfa-e49698d88061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ce590f-c66d-4685-8dfa-e49698d88061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1636500502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd87537-0166-42ab-96e5-7c89fe2b0fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4845470e1c457db49991731a9db5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:48Z,use_quota=True,user_id='924718e5c2c84ac2aaca6a98432cd2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc2d606-e64c-4c5c-9198-8702719e65b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc2d606-e64c-4c5c-9198-8702719e65b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1098dee2-bc25-4f5b-965a-795a16609ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1098dee2-bc25-4f5b-965a-795a16609ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd87537-0166-42ab-96e5-7c89fe2b0fc4', 'volume_name': 'volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c71816a-b2ae-4859-bda6-b1f039156e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c71816a-b2ae-4859-bda6-b1f039156e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fbb4de-8f4b-4c0f-b684-cdc00cf7b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Volume 5fd87537-0166-42ab-96e5-7c89fe2b0fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4', 'volume_size': 1} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1636500502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd87537-0166-42ab-96e5-7c89fe2b0fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4845470e1c457db49991731a9db5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:48Z,use_quota=True,user_id='924718e5c2c84ac2aaca6a98432cd2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Creating volume 5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:48 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:48 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 1073741824 Sep 28 15:07:48 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Flow 'volume_create_manager' (3e142735-1968-4888-b1bb-dc9e2fd17da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d305c6-fa8f-481c-bf54-0958637e11e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d305c6-fa8f-481c-bf54-0958637e11e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-436008631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41fc4903-f4f3-4c9d-aec5-de45ac9324be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ad9a2af4644bcdb74ebbaa85e48134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:49Z,use_quota=True,user_id='67a96e64ebf347ecb17f9863525d63d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d540c988-f462-4cf5-8420-ddc106cbe6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d540c988-f462-4cf5-8420-ddc106cbe6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce142c8-668b-43ab-88d7-b7cbf1b77bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce142c8-668b-43ab-88d7-b7cbf1b77bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41fc4903-f4f3-4c9d-aec5-de45ac9324be', 'volume_name': 'volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c2e73c-1832-41fe-b59a-8b6f81d1604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c2e73c-1832-41fe-b59a-8b6f81d1604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d695a88-84ba-4644-ae9f-9bcc48175d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Volume 41fc4903-f4f3-4c9d-aec5-de45ac9324be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be', 'volume_size': 1} Sep 28 15:07:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:49 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 1073741824" returned: 0 in 0.782s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:49 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 Sep 28 15:07:49 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:50 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" returned: 0 in 0.401s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-436008631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41fc4903-f4f3-4c9d-aec5-de45ac9324be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ad9a2af4644bcdb74ebbaa85e48134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:49Z,use_quota=True,user_id='67a96e64ebf347ecb17f9863525d63d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Creating volume 41fc4903-f4f3-4c9d-aec5-de45ac9324be {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:50 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fbb4de-8f4b-4c0f-b684-cdc00cf7b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:50 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be 1073741824 Sep 28 15:07:50 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0ce2eb-a136-4c22-b788-45b0a8f741e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:50 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Volume volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 (5fd87537-0166-42ab-96e5-7c89fe2b0fc4): created successfully Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0ce2eb-a136-4c22-b788-45b0a8f741e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Flow 'volume_create_manager' (cd841b06-fd2a-4b6c-ba10-0cb551f96ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:50 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7cd66962-00ff-48e6-b22d-7a425c022ffc tempest-SnapshotMetadataTestJSON-1849102928 None] Created volume successfully. Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:51 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be 1073741824" returned: 0 in 1.195s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:51 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be Sep 28 15:07:51 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:51 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be" returned: 0 in 0.396s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.602s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Creating offline snapshot 07c79951-6abf-488b-a6e0-33f24ae9078c of volume 5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d695a88-84ba-4644-ae9f-9bcc48175d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b5cba6-c67a-4e9a-b410-112bf9c0c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e3ac1-28d4-408b-8173-897dbdc88550]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:51 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Volume volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be (41fc4903-f4f3-4c9d-aec5-de45ac9324be): created successfully Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b5cba6-c67a-4e9a-b410-112bf9c0c354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Flow 'volume_create_manager' (3e142735-1968-4888-b1bb-dc9e2fd17da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-71a5f021-7ca9-4b8f-b857-093b10622407 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Created volume successfully. Sep 28 15:07:51 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 Sep 28 15:07:51 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" returned: 0 in 0.515s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c 1G Sep 28 15:07:52 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c 1G" returned: 0 in 0.642s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c Sep 28 15:07:52 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:53 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:53 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c is being set with open permissions: ugo+rw Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:53 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c Sep 28 15:07:53 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:53 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c" returned: 0 in 0.395s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:53 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.info Sep 28 15:07:53 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Flow 'volume_create_manager' (50cca2b0-6330-456d-bec1-443b44785475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc24a7e-3f2d-4ded-9a3a-b1da7d239c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc24a7e-3f2d-4ded-9a3a-b1da7d239c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1426098183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f0e703-9f51-410f-8492-cb4f09823a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26245695e2784bda8a296547b7f89a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:54Z,use_quota=True,user_id='f2219e739e9347d0b78c5f44278500c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547b6f6e-69c7-48c1-9149-dc5507e7ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547b6f6e-69c7-48c1-9149-dc5507e7ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3562db-9e29-46ca-9503-34622af467e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3562db-9e29-46ca-9503-34622af467e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72f0e703-9f51-410f-8492-cb4f09823a3d', 'volume_name': 'volume-72f0e703-9f51-410f-8492-cb4f09823a3d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239385e4-dba1-45c5-a12e-dcd61a61d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239385e4-dba1-45c5-a12e-dcd61a61d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df8df14-5fc9-41a0-a973-1ee444782a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Volume 72f0e703-9f51-410f-8492-cb4f09823a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72f0e703-9f51-410f-8492-cb4f09823a3d', 'volume_size': 1} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:54 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.info" returned: 0 in 0.484s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:54 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.info is being set with open permissions: ugo+rw Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.info Sep 28 15:07:54 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.info" returned: 0 in 0.327s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.633s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1426098183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f0e703-9f51-410f-8492-cb4f09823a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26245695e2784bda8a296547b7f89a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:54Z,use_quota=True,user_id='f2219e739e9347d0b78c5f44278500c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Creating volume 72f0e703-9f51-410f-8492-cb4f09823a3d {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:54 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d 1073741824 Sep 28 15:07:54 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6380814a-102d-4638-b1b9-1b8e106092e5 tempest-SnapshotMetadataTestJSON-1849102928 None] Create snapshot completed successfully Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Acquiring lock "cinder-41fc4903-f4f3-4c9d-aec5-de45ac9324be-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "cinder-41fc4903-f4f3-4c9d-aec5-de45ac9324be-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Acquiring lock "cinder-quobyte-41fc4903-f4f3-4c9d-aec5-de45ac9324be" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "cinder-quobyte-41fc4903-f4f3-4c9d-aec5-de45ac9324be" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca1609-38c6-424f-940e-9205340b847c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be Sep 28 15:07:55 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d 1073741824" returned: 0 in 0.712s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be" returned: 0 in 0.570s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d Sep 28 15:07:55 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be Sep 28 15:07:55 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-41fc4903-f4f3-4c9d-aec5-de45ac9324be" returned: 0 in 0.330s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "cinder-quobyte-41fc4903-f4f3-4c9d-aec5-de45ac9324be" released by "delete_volume" :: held 0.990s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d" returned: 0 in 0.424s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df8df14-5fc9-41a0-a973-1ee444782a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f0e703-9f51-410f-8492-cb4f09823a3d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e221cf1d-ff19-4161-8e36-d645dc7f7762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:56 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Volume volume-72f0e703-9f51-410f-8492-cb4f09823a3d (72f0e703-9f51-410f-8492-cb4f09823a3d): created successfully Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e221cf1d-ff19-4161-8e36-d645dc7f7762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Flow 'volume_create_manager' (50cca2b0-6330-456d-bec1-443b44785475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f9d3bde4-9c68-445f-8e34-80264551a98b tempest-AttachVolumeNegativeTest-760384332 None] Created volume successfully. Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Created reservations ['9f118f1c-fa40-4945-8b56-ac1b87166df8', '3d6e2fd3-fc19-4c6e-904e-5b0137fd7249', '5ce1f15d-29b3-4ea3-a7ce-21c284ef2efc', '86ad2c45-5731-4f58-8da7-595dbe34b672'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:56 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:07:56 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "cinder-07c79951-6abf-488b-a6e0-33f24ae9078c-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-07c79951-6abf-488b-a6e0-33f24ae9078c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "cinder-quobyte-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-quobyte-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "cinder-quobyte-07c79951-6abf-488b-a6e0-33f24ae9078c" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-quobyte-07c79951-6abf-488b-a6e0-33f24ae9078c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Deleting offline snapshot 07c79951-6abf-488b-a6e0-33f24ae9078c of volume 5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:56 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] snapshot_file for this snap is: volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.364s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d33374-ca34-45f1-92a0-9ba64e281908]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Deleted volume successfully. Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-aac433bb-eb7f-48a8-b372-a2c630734b45 tempest-VolumeQuotasNegativeTestJSON-716625958 None] Lock "cinder-41fc4903-f4f3-4c9d-aec5-de45ac9324be-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:56 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c Sep 28 15:07:56 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:56 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c" returned: 0 in 0.408s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:57 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca96641d-97f1-42b3-b6f4-6cd90c2e8b7b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 Sep 28 15:07:57 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" returned: 0 in 0.567s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c Sep 28 15:07:57 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:58 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c" returned: 0 in 0.686s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:58 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c Sep 28 15:07:58 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-32633a9f-8477-4625-b77c-abd4cee2afac req-ed2c97c9-f445-4011-94a6-d3418fdd5090 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-32633a9f-8477-4625-b77c-abd4cee2afac req-ed2c97c9-f445-4011-94a6-d3418fdd5090 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-32633a9f-8477-4625-b77c-abd4cee2afac req-ed2c97c9-f445-4011-94a6-d3418fdd5090 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-32633a9f-8477-4625-b77c-abd4cee2afac req-ed2c97c9-f445-4011-94a6-d3418fdd5090 tempest-AttachVolumeNegativeTest-760384332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-72f0e703-9f51-410f-8492-cb4f09823a3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a895c59f-28c8-466a-accb-27bb66d614f0', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:58 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4.07c79951-6abf-488b-a6e0-33f24ae9078c" returned: 0 in 0.386s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-quobyte-07c79951-6abf-488b-a6e0-33f24ae9078c" released by "_delete_snapshot" :: held 2.207s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-quobyte-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" released by "delete_snapshot" :: held 2.235s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-32633a9f-8477-4625-b77c-abd4cee2afac req-ed2c97c9-f445-4011-94a6-d3418fdd5090 tempest-AttachVolumeNegativeTest-760384332 None] attachment_update completed successfully. Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Created reservations ['e88733f0-0061-4ec3-a8d2-993075c06cb1', 'cc42d533-0a51-44ee-891e-80153ada6b4f', 'ee6ae766-e6da-422b-8b49-e0a7c204a7f1', 'ee38dd57-a5b8-4a65-99b1-d4bada531198'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Delete snapshot completed successfully. Sep 28 15:07:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ac7c0870-a1d1-45ac-8d77-9830b635087b tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-07c79951-6abf-488b-a6e0-33f24ae9078c-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "cinder-5fd87537-0166-42ab-96e5-7c89fe2b0fc4-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-5fd87537-0166-42ab-96e5-7c89fe2b0fc4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "cinder-quobyte-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-quobyte-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" acquired by "delete_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:00 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a1322-92e6-46b6-871d-5e630c76fb52]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:00 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 Sep 28 15:08:00 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:00 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" returned: 0 in 0.588s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:00 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4 Sep 28 15:08:00 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:01 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" returned: 0 in 0.376s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-quobyte-5fd87537-0166-42ab-96e5-7c89fe2b0fc4" released by "delete_volume" :: held 1.115s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Created reservations ['f3455cbc-b2e6-4981-87e6-61d19c30a6a9', '85463a03-95d6-4a7d-b222-763e43e09311', 'b92be3fc-2da9-4372-8066-ab96a8b264d3', '16f6407e-1f20-44b1-9bad-99807f169749'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:01 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:01 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:01 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.400s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-8bcd2a1e-9454-4ebd-962a-789ae53d57f4 req-e7e92106-5fe9-4b91-9f43-b654d115c4b2 tempest-AttachVolumeNegativeTest-760384332 None] Terminate volume connection completed successfully. Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-8bcd2a1e-9454-4ebd-962a-789ae53d57f4 req-e7e92106-5fe9-4b91-9f43-b654d115c4b2 tempest-AttachVolumeNegativeTest-760384332 None] Deleting attachment a895c59f-28c8-466a-accb-27bb66d614f0. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:08:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Deleted volume successfully. Sep 28 15:08:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-50a3154e-0af2-49c7-a84a-9a63f7d8858c tempest-SnapshotMetadataTestJSON-1849102928 None] Lock "cinder-5fd87537-0166-42ab-96e5-7c89fe2b0fc4-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "cinder-72f0e703-9f51-410f-8492-cb4f09823a3d-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-72f0e703-9f51-410f-8492-cb4f09823a3d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "cinder-quobyte-72f0e703-9f51-410f-8492-cb4f09823a3d" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-quobyte-72f0e703-9f51-410f-8492-cb4f09823a3d" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c285f02d-345f-41ed-9bbf-416d76a40c8b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:08 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d Sep 28 15:08:08 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Flow 'volume_create_manager' (bedb08cc-2cde-42ba-b58b-fa648559c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc54911-d174-423b-a3d0-a3a4c7c010d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc54911-d174-423b-a3d0-a3a4c7c010d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1569733968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92767d7ddaf437f86df403a55a63b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:09Z,use_quota=True,user_id='61a0e571cce341c59890eee132cc4fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cc5d7c7-c3af-4e00-b814-4d5ec930a932),volume_type_id=6cc5d7c7-c3af-4e00-b814-4d5ec930a932)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9d83ec-0268-4706-8cbd-901b5bdeebf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9d83ec-0268-4706-8cbd-901b5bdeebf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81584e23-dbe8-40fe-8e26-c6281bf5f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81584e23-dbe8-40fe-8e26-c6281bf5f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f', 'volume_name': 'volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5345870b-714f-4f6b-8f63-fc8969095f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5345870b-714f-4f6b-8f63-fc8969095f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34ba1e4-b027-426e-8f67-1f1c974c9803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Volume 79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f', 'volume_size': 1} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1569733968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92767d7ddaf437f86df403a55a63b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:09Z,use_quota=True,user_id='61a0e571cce341c59890eee132cc4fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cc5d7c7-c3af-4e00-b814-4d5ec930a932),volume_type_id=6cc5d7c7-c3af-4e00-b814-4d5ec930a932)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Creating volume 79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:08 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:08 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f 1073741824 Sep 28 15:08:08 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:08 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d" returned: 0 in 0.493s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d Sep 28 15:08:09 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:09 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-72f0e703-9f51-410f-8492-cb4f09823a3d" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-quobyte-72f0e703-9f51-410f-8492-cb4f09823a3d" released by "delete_volume" :: held 0.884s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:09 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f 1073741824" returned: 0 in 0.566s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Created reservations ['2b2e0765-fb47-4a01-90da-8a91292429e5', 'bd01b935-edae-446f-80c2-c14e97d6e46b', '39a96e08-f6ca-439c-aba1-bfe00e2e4de8', '694cba44-ded3-4807-982b-0ae8bb108597'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f Sep 28 15:08:09 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:09 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:09 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f" returned: 0 in 0.373s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "cinder-cf10a86b-904f-4712-bc21-9c15b2835deb-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34ba1e4-b027-426e-8f67-1f1c974c9803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1632b0e0-d816-4c17-91e6-7822b506d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-cf10a86b-904f-4712-bc21-9c15b2835deb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:09 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Volume volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f (79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f): created successfully Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1632b0e0-d816-4c17-91e6-7822b506d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Flow 'volume_create_manager' (bedb08cc-2cde-42ba-b58b-fa648559c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7467fdc7-cc29-4e21-a501-5b0ae7ca45f1 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Created volume successfully. Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "cinder-quobyte-cf10a86b-904f-4712-bc21-9c15b2835deb" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-quobyte-cf10a86b-904f-4712-bc21-9c15b2835deb" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:09 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.447s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Deleted volume successfully. Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacd049b-28c6-42c4-8799-9df6fa5d9f1e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6b69b45e-00da-4895-a162-24a701c269f4 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-72f0e703-9f51-410f-8492-cb4f09823a3d-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:10 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb Sep 28 15:08:10 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb" returned: 0 in 0.445s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:10 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb Sep 28 15:08:10 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf10a86b-904f-4712-bc21-9c15b2835deb" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-quobyte-cf10a86b-904f-4712-bc21-9c15b2835deb" released by "delete_volume" :: held 0.831s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Flow 'volume_create_manager' (04ec57b7-f3e4-4093-b7a1-eb81f22d9625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e76a08-0ff2-4b4d-bcb6-11122ece7a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e76a08-0ff2-4b4d-bcb6-11122ece7a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-25971617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bbc45a-9bba-48a9-b40d-d11361b714f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066e07a1834049ddb41d22603467e8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:11Z,use_quota=True,user_id='9faa0ce663fd4eddab467c6b4184af36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fab5153-c249-4db5-9ae5-2fb11cbc4822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fab5153-c249-4db5-9ae5-2fb11cbc4822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd02898d-1eb0-4f86-9e0a-9d49c85a0d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd02898d-1eb0-4f86-9e0a-9d49c85a0d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bbc45a-9bba-48a9-b40d-d11361b714f9', 'volume_name': 'volume-07bbc45a-9bba-48a9-b40d-d11361b714f9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e82a6f-93a0-46ab-b817-9c9665c691b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e82a6f-93a0-46ab-b817-9c9665c691b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb51823-30a7-4fc7-b84d-6ded123ee773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:10 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Volume 07bbc45a-9bba-48a9-b40d-d11361b714f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bbc45a-9bba-48a9-b40d-d11361b714f9', 'volume_size': 1} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-25971617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bbc45a-9bba-48a9-b40d-d11361b714f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066e07a1834049ddb41d22603467e8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:11Z,use_quota=True,user_id='9faa0ce663fd4eddab467c6b4184af36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Creating volume 07bbc45a-9bba-48a9-b40d-d11361b714f9 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:10 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:08:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:10 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 1073741824 Sep 28 15:08:10 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Created reservations ['aa5d3c0e-12fe-435e-b407-1e07ea296960', '5c24ff36-ad76-4560-9998-30d626777960', '7d69ed77-cd6d-459c-a92e-7ded88074174', '27a36aa8-494a-4b97-b58f-2362b74c7380'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:11 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:11 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:11 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:11 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:11 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.412s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Deleted volume successfully. Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5ac5b9a6-536d-40cc-a6ff-b8cfcedeff84 tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-cf10a86b-904f-4712-bc21-9c15b2835deb-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:11 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 1073741824" returned: 0 in 0.649s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:11 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 Sep 28 15:08:11 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:11 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.291s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-77c33c72-f6e5-4303-9365-e90fe2fd0c50 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Retype volume completed successfully. Sep 28 15:08:11 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9" returned: 0 in 0.267s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb51823-30a7-4fc7-b84d-6ded123ee773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bbc45a-9bba-48a9-b40d-d11361b714f9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9304ef1-190e-49af-86a8-154aad2e2a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Volume volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 (07bbc45a-9bba-48a9-b40d-d11361b714f9): created successfully Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9304ef1-190e-49af-86a8-154aad2e2a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Flow 'volume_create_manager' (04ec57b7-f3e4-4093-b7a1-eb81f22d9625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-eeda86e3-2c71-40a3-85b1-942a50b37278 tempest-AbsoluteLimitsTests-1386633837 None] Created volume successfully. Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "cinder-9e17d244-b50a-4e24-b4c2-b7d92e04dce3-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-9e17d244-b50a-4e24-b4c2-b7d92e04dce3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "cinder-quobyte-9e17d244-b50a-4e24-b4c2-b7d92e04dce3" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-quobyte-9e17d244-b50a-4e24-b4c2-b7d92e04dce3" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda34f3f-b858-494b-8eb1-7b9c5596dc17]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:12 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 Sep 28 15:08:12 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Acquiring lock "cinder-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "cinder-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:13 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3" returned: 0 in 0.579s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Acquiring lock "cinder-quobyte-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:13 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3 Sep 28 15:08:13 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "cinder-quobyte-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d797d-74fc-445b-8728-6127011ca7ef]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Acquiring lock "cinder-07bbc45a-9bba-48a9-b40d-d11361b714f9-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:13 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f Sep 28 15:08:13 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Lock "cinder-07bbc45a-9bba-48a9-b40d-d11361b714f9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Acquiring lock "cinder-quobyte-07bbc45a-9bba-48a9-b40d-d11361b714f9" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Lock "cinder-quobyte-07bbc45a-9bba-48a9-b40d-d11361b714f9" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb392c-c816-4127-9647-885cdab4b79d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9e17d244-b50a-4e24-b4c2-b7d92e04dce3" returned: 0 in 0.477s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-quobyte-9e17d244-b50a-4e24-b4c2-b7d92e04dce3" released by "delete_volume" :: held 1.133s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:13 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 Sep 28 15:08:13 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Created reservations ['498c56af-f8d5-413a-815d-edd87bcb3ee5', '5eaa51a2-d77c-4d00-ae21-a0439d566637', '02d715fe-eb34-4cb8-a698-94e43c65a2bb', 'df561ebd-9eee-45da-a941-316712963307'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:13 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f" returned: 0 in 0.551s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f Sep 28 15:08:13 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:13 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:13 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9" returned: 0 in 0.495s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9 Sep 28 15:08:13 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:14 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "cinder-quobyte-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f" released by "delete_volume" :: held 0.950s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:14 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:14 devstack cinder-volume[86384]: WARNING cinder.quota [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:14 devstack cinder-volume[86384]: WARNING cinder.quota [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.336s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Deleted volume successfully. Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Created reservations ['a2bb0dfc-aa51-48d4-8247-f17597dc2459', '406acf29-6fe2-40ef-9a30-2ea2cb514b66', '58d64fe6-d9c6-4237-be22-672567210c1b', '8331db3f-8f13-459c-b6b0-bcb7c7d705fa'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-920c375d-b782-4bbe-ac75-9db63e10ea9c tempest-AttachVolumeNegativeTest-760384332 None] Lock "cinder-9e17d244-b50a-4e24-b4c2-b7d92e04dce3-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:14 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-07bbc45a-9bba-48a9-b40d-d11361b714f9" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:14 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:14 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Lock "cinder-quobyte-07bbc45a-9bba-48a9-b40d-d11361b714f9" released by "delete_volume" :: held 0.910s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Created reservations ['71ec5f74-576e-45d3-9a4f-450d5aba2eb5', 'a62009ed-b4d9-452e-8cb6-298157264f03', '2830acbb-5b22-4e0d-bfcf-600f68571510', '9afb110d-b312-47c6-a1a4-a7a8f4621a64'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:14 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:14 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:14 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.360s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Deleted volume successfully. Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd1bf470-4837-4787-8e54-235cca950ca0 tempest-VolumeRetypeWithoutMigrationTest-1462595180 None] Lock "cinder-79c322f8-5552-4ca7-bd6c-21ebaf8b1e6f-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:14 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.339s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Deleted volume successfully. Sep 28 15:08:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-087a7d65-33e5-4231-aae3-9e7afda98059 tempest-AbsoluteLimitsTests-1386633837 None] Lock "cinder-07bbc45a-9bba-48a9-b40d-d11361b714f9-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Acquiring lock "cinder-60c84d30-94f0-4f92-a91e-6891f394e683-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "cinder-60c84d30-94f0-4f92-a91e-6891f394e683-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Acquiring lock "cinder-quobyte-60c84d30-94f0-4f92-a91e-6891f394e683" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "cinder-quobyte-60c84d30-94f0-4f92-a91e-6891f394e683" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4303c45e-4069-4b91-83db-1859c4de714b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:24 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 Sep 28 15:08:24 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:24 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683" returned: 0 in 0.506s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:24 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683 Sep 28 15:08:24 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:25 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-60c84d30-94f0-4f92-a91e-6891f394e683" returned: 0 in 0.395s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "cinder-quobyte-60c84d30-94f0-4f92-a91e-6891f394e683" released by "delete_volume" :: held 1.002s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Created reservations ['35044316-92f2-4e21-a1ab-ddd40a21613f', '6bee7da3-c1cf-4ff1-a057-0f46e12ebd53', 'ea786de6-9986-45f0-aa9d-185b0c3bb17b', '93f0ec24-18f8-4eae-a3cf-ee56f6e21681'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:25 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:25 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:25 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.407s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Deleted volume successfully. Sep 28 15:08:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c68e0932-5a36-4a3e-8c49-bb8aeacbc5cd tempest-AttachVolumeShelveTestJSON-1660949402 None] Lock "cinder-60c84d30-94f0-4f92-a91e-6891f394e683-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:26 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Flow 'volume_create_manager' (4731633d-6423-4eb3-a98a-5290442b5b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf7b25-cdbb-4a6a-83d7-e72cd11ec835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf7b25-cdbb-4a6a-83d7-e72cd11ec835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1470306522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c05c02-d455-4940-bd02-a9577aafc2ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5927c8dfe8e401d8a11238a3298e0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:27Z,use_quota=True,user_id='0716d8d7069e474f838f9fa941605214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467b712d-c812-453a-8283-2be7fa29ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467b712d-c812-453a-8283-2be7fa29ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb86235-61f0-4acb-89fb-f198ee237b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb86235-61f0-4acb-89fb-f198ee237b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c05c02-d455-4940-bd02-a9577aafc2ff', 'volume_name': 'volume-25c05c02-d455-4940-bd02-a9577aafc2ff', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8e4702-9d60-4df5-9c6d-33df2a1816d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8e4702-9d60-4df5-9c6d-33df2a1816d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a30678-db75-46e1-a633-32c1a8da7fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:27 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Volume 25c05c02-d455-4940-bd02-a9577aafc2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c05c02-d455-4940-bd02-a9577aafc2ff', 'volume_size': 1} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1470306522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c05c02-d455-4940-bd02-a9577aafc2ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5927c8dfe8e401d8a11238a3298e0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:27Z,use_quota=True,user_id='0716d8d7069e474f838f9fa941605214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Creating volume 25c05c02-d455-4940-bd02-a9577aafc2ff {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:27 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:27 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff 1073741824 Sep 28 15:08:27 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:27 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff 1073741824" returned: 0 in 0.667s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:27 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff Sep 28 15:08:27 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff" returned: 0 in 0.509s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a30678-db75-46e1-a633-32c1a8da7fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c05c02-d455-4940-bd02-a9577aafc2ff', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0f70ab-9fdd-4191-8087-e49cde633f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:28 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Volume volume-25c05c02-d455-4940-bd02-a9577aafc2ff (25c05c02-d455-4940-bd02-a9577aafc2ff): created successfully Sep 28 15:08:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0f70ab-9fdd-4191-8087-e49cde633f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Flow 'volume_create_manager' (4731633d-6423-4eb3-a98a-5290442b5b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:28 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-660389f2-b2e7-48f4-8180-9a521d2b308f req-3d6b0f9f-29aa-4577-a0f0-c2d2962d3bc7 tempest-VolumesGetTestJSON-993771699 None] Created volume successfully. Sep 28 15:08:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Acquiring lock "cinder-25c05c02-d455-4940-bd02-a9577aafc2ff-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Lock "cinder-25c05c02-d455-4940-bd02-a9577aafc2ff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Acquiring lock "cinder-quobyte-25c05c02-d455-4940-bd02-a9577aafc2ff" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Lock "cinder-quobyte-25c05c02-d455-4940-bd02-a9577aafc2ff" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:29 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[825dd3e9-cd37-4330-bb5d-56d190a0af82]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff Sep 28 15:08:30 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff" returned: 0 in 0.522s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff Sep 28 15:08:30 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-25c05c02-d455-4940-bd02-a9577aafc2ff" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Lock "cinder-quobyte-25c05c02-d455-4940-bd02-a9577aafc2ff" released by "delete_volume" :: held 0.944s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:30 devstack cinder-volume[86384]: DEBUG cinder.quota [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Created reservations ['63c9d013-3dbf-48d0-97a8-51cbd08417b4', '3e9e78b7-ebf8-4f39-9692-223cbdc1c43c', 'b15e3aff-326a-4096-9ac7-665c901f94b0', '2d73949e-03b3-4595-a110-2e0614db3437'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:31 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:31 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:31 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG cinder.manager [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Deleted volume successfully. Sep 28 15:08:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-69550c01-a906-4deb-b79c-629efecacac1 req-d7358b40-a932-444e-b846-dc1b4ab47450 tempest-VolumesGetTestJSON-993771699 None] Lock "cinder-25c05c02-d455-4940-bd02-a9577aafc2ff-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:33 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:08:33 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:34 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:08:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:08:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7c4d6842-8112-4a14-b519-044b1dab9373 tempest-BackendsCapabilitiesAdminTestsJSON-1254690948 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86384) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:08:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2b91d182-b223-48a0-b85d-1d5eab6b12aa tempest-BackendsCapabilitiesAdminTestsJSON-1254690948 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86384) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:08:43 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=88,cinder:UPDATE=99,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:43 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=108,cinder:SELECT=74,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Flow 'volume_create_manager' (be45aa9a-3043-4591-9513-d28c87c3f54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286eb8d7-78bf-42de-ba64-1271bf6c622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-76896d06-e94d-465f-9243-9cb16c50f575 tempest-GroupSnapshotsV319Test-944071237 None] Group tempest-GroupSnapshotsV319Test-Group-387655863: creating Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286eb8d7-78bf-42de-ba64-1271bf6c622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1939736130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2432321-3f8b-4f33-8f6e-83ca461e43a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277362a3c98b40368a42d6572d25915c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:44Z,use_quota=True,user_id='01d226a4be9343399afb527dee105409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d2611-a748-4876-bf28-2dad73cfaf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d2611-a748-4876-bf28-2dad73cfaf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac04b366-120e-4fa1-98ca-f6f3834cdecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac04b366-120e-4fa1-98ca-f6f3834cdecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2432321-3f8b-4f33-8f6e-83ca461e43a8', 'volume_name': 'volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcc6f8f-46a2-4ed0-9620-ec6aeb34f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcc6f8f-46a2-4ed0-9620-ec6aeb34f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bdec11-acc6-4bb5-9ed0-e2969fc1dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:44 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Volume f2432321-3f8b-4f33-8f6e-83ca461e43a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8', 'volume_size': 1} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1939736130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2432321-3f8b-4f33-8f6e-83ca461e43a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277362a3c98b40368a42d6572d25915c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:44Z,use_quota=True,user_id='01d226a4be9343399afb527dee105409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Creating volume f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:44 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:08:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:44 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 1073741824 Sep 28 15:08:44 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-76896d06-e94d-465f-9243-9cb16c50f575 tempest-GroupSnapshotsV319Test-944071237 None] Group tempest-GroupSnapshotsV319Test-Group-387655863: created successfully Sep 28 15:08:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-76896d06-e94d-465f-9243-9cb16c50f575 tempest-GroupSnapshotsV319Test-944071237 None] Create group completed successfully. Sep 28 15:08:45 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 1073741824" returned: 0 in 0.663s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:45 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:08:45 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:45 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.363s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bdec11-acc6-4bb5-9ed0-e2969fc1dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb878e77-e3ee-4012-b32d-920b6a86cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:45 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Volume volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 (f2432321-3f8b-4f33-8f6e-83ca461e43a8): created successfully Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb878e77-e3ee-4012-b32d-920b6a86cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Flow 'volume_create_manager' (be45aa9a-3043-4591-9513-d28c87c3f54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ccf03ff5-d55c-4e06-962d-c71d4bd90d58 tempest-VolumesActionsTest-1017232961 None] Created volume successfully. Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Flow 'volume_create_manager' (095e641c-9743-4464-863b-f68e54619e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b26406-a6d6-4af6-aa3f-8d31c8456054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b26406-a6d6-4af6-aa3f-8d31c8456054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608767535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=226c7a98-1db4-4c18-a317-5900253e4aad,host='devstack@QuobyteHD#QuobyteHD',id=5f17bb62-9838-45ef-81f7-c931ad674312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db3f811c80c4b7083a4ec29676d06a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:46Z,use_quota=True,user_id='3a89fcb9e8a94e4d9df2568df53888ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68bda8c9-ecae-4001-945c-2148dc617cc1),volume_type_id=68bda8c9-ecae-4001-945c-2148dc617cc1)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5221984-2479-4a31-ab29-1a5529355a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5221984-2479-4a31-ab29-1a5529355a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2eaecd-561c-4078-b98e-ec37561da326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2eaecd-561c-4078-b98e-ec37561da326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f17bb62-9838-45ef-81f7-c931ad674312', 'volume_name': 'volume-5f17bb62-9838-45ef-81f7-c931ad674312', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8387d3-e5cf-4db3-930c-ab5f7dac89c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8387d3-e5cf-4db3-930c-ab5f7dac89c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f841c99c-453a-432e-963f-cd2a75e039ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:46 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Volume 5f17bb62-9838-45ef-81f7-c931ad674312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f17bb62-9838-45ef-81f7-c931ad674312', 'volume_size': 1} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=226c7a98-1db4-4c18-a317-5900253e4aad,created_at=2026-09-28T13:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608767535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=226c7a98-1db4-4c18-a317-5900253e4aad,host='devstack@QuobyteHD#QuobyteHD',id=5f17bb62-9838-45ef-81f7-c931ad674312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db3f811c80c4b7083a4ec29676d06a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:46Z,use_quota=True,user_id='3a89fcb9e8a94e4d9df2568df53888ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68bda8c9-ecae-4001-945c-2148dc617cc1),volume_type_id=68bda8c9-ecae-4001-945c-2148dc617cc1)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Creating volume 5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:46 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:08:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 1073741824 Sep 28 15:08:46 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 1073741824" returned: 0 in 0.712s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 Sep 28 15:08:47 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312" returned: 0 in 0.516s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f841c99c-453a-432e-963f-cd2a75e039ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f17bb62-9838-45ef-81f7-c931ad674312', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac71ca8-3726-4497-b047-ec2fb637e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:47 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Volume volume-5f17bb62-9838-45ef-81f7-c931ad674312 (5f17bb62-9838-45ef-81f7-c931ad674312): created successfully Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac71ca8-3726-4497-b047-ec2fb637e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Flow 'volume_create_manager' (095e641c-9743-4464-863b-f68e54619e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:48 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d35f52dd-7b9f-4d8e-be9e-0b21472b5da5 tempest-GroupSnapshotsV319Test-944071237 None] Created volume successfully. Sep 28 15:08:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] GroupSnapshot da66dc8c-8263-4886-945c-bd10e48af8d8: creating. Sep 28 15:08:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Group snapshot da66dc8c-8263-4886-945c-bd10e48af8d8: creating. {{(pid=86384) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:08:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Creating offline snapshot 98435001-039d-41e3-88c7-4ed367de3359 of volume 5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c4d52-367a-4bc5-9436-584dab7b5834]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 Sep 28 15:08:49 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:50 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312" returned: 0 in 0.726s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:50 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 1G Sep 28 15:08:50 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8127c1ef-63d6-40eb-9247-8b35776ff1c6 tempest-GroupsTest-1905039420 None] Group tempest-Group1-59708759: creating Sep 28 15:08:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8127c1ef-63d6-40eb-9247-8b35776ff1c6 tempest-GroupsTest-1905039420 None] Group tempest-Group1-59708759: created successfully Sep 28 15:08:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8127c1ef-63d6-40eb-9247-8b35776ff1c6 tempest-GroupsTest-1905039420 None] Create group completed successfully. Sep 28 15:08:51 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 1G" returned: 0 in 0.738s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f17bb62-9838-45ef-81f7-c931ad674312 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:51 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f17bb62-9838-45ef-81f7-c931ad674312 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 Sep 28 15:08:51 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:51 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f17bb62-9838-45ef-81f7-c931ad674312 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359" returned: 0 in 0.520s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:51 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:08:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:51 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 Sep 28 15:08:51 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:51 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359" returned: 0 in 0.356s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:52 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.info Sep 28 15:08:52 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8ac9ab55-e224-4741-8856-0a66edf994d2 tempest-GroupsTest-1905039420 None] Group tempest-Group2-1435729307: creating Sep 28 15:08:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8ac9ab55-e224-4741-8856-0a66edf994d2 tempest-GroupsTest-1905039420 None] Group tempest-Group2-1435729307: created successfully Sep 28 15:08:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8ac9ab55-e224-4741-8856-0a66edf994d2 tempest-GroupsTest-1905039420 None] Create group completed successfully. Sep 28 15:08:52 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.info" returned: 0 in 0.491s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:08:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:52 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.info Sep 28 15:08:52 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:52 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.info" returned: 0 in 0.345s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:53 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8d973fa8-82d4-42b2-89de-17f62993d2f9 tempest-GroupSnapshotsV319Test-944071237 None] group_snapshot da66dc8c-8263-4886-945c-bd10e48af8d8: created successfully Sep 28 15:08:54 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Flow 'volume_create_manager' (ac3d28ae-504c-4dce-8122-6ab0ea35228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97757e21-4476-4dde-8ed6-0d2df039095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97757e21-4476-4dde-8ed6-0d2df039095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262462322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=304bc7d7-eb53-43b1-b064-e4d15f88474e,host='devstack@QuobyteHD#QuobyteHD',id=fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf5c8725d64fa880eee6f8f430ebdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:55Z,use_quota=True,user_id='09a0b49e21814d77b67ccb3332d46dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d39df259-81f0-46ad-a87c-174d123c99e8),volume_type_id=d39df259-81f0-46ad-a87c-174d123c99e8)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8456ef32-ab56-4ce2-9625-e01ca175c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8456ef32-ab56-4ce2-9625-e01ca175c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:54 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd3af1f-ea8f-4700-912a-e81f651593c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd3af1f-ea8f-4700-912a-e81f651593c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0', 'volume_name': 'volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b929964-d0ce-43b5-9457-a5701649f61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b929964-d0ce-43b5-9457-a5701649f61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b822d34-6a6c-4485-a6a5-48ab13058c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:55 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Volume fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0', 'volume_size': 1} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=304bc7d7-eb53-43b1-b064-e4d15f88474e,created_at=2026-09-28T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262462322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=304bc7d7-eb53-43b1-b064-e4d15f88474e,host='devstack@QuobyteHD#QuobyteHD',id=fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf5c8725d64fa880eee6f8f430ebdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:55Z,use_quota=True,user_id='09a0b49e21814d77b67ccb3332d46dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d39df259-81f0-46ad-a87c-174d123c99e8),volume_type_id=d39df259-81f0-46ad-a87c-174d123c99e8)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Creating volume fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:55 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] group_snapshot da66dc8c-8263-4886-945c-bd10e48af8d8: deleting Sep 28 15:08:55 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 1073741824 Sep 28 15:08:55 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] group_snapshot da66dc8c-8263-4886-945c-bd10e48af8d8: deleting {{(pid=86384) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Acquiring lock "cinder-quobyte-5f17bb62-9838-45ef-81f7-c931ad674312" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Lock "cinder-quobyte-5f17bb62-9838-45ef-81f7-c931ad674312" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Acquiring lock "cinder-quobyte-98435001-039d-41e3-88c7-4ed367de3359" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Lock "cinder-quobyte-98435001-039d-41e3-88c7-4ed367de3359" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Deleting offline snapshot 98435001-039d-41e3-88c7-4ed367de3359 of volume 5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] snapshot_file for this snap is: volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bcf5cf-ac7f-4403-9d25-bb845ef61200]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:55 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 Sep 28 15:08:55 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 1073741824" returned: 0 in 1.032s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 Sep 28 15:08:56 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359" returned: 0 in 0.911s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f17bb62-9838-45ef-81f7-c931ad674312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:56 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[def7e289-cf93-409e-b9af-633348581ad6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 Sep 28 15:08:56 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:57 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0" returned: 0 in 0.980s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b822d34-6a6c-4485-a6a5-48ab13058c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c709598-cdc7-4872-ab01-a669f9b1b15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:57 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312" returned: 0 in 0.643s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Volume volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 (fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0): created successfully Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c709598-cdc7-4872-ab01-a669f9b1b15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:57 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 Sep 28 15:08:57 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Flow 'volume_create_manager' (ac3d28ae-504c-4dce-8122-6ab0ea35228a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:57 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d48a03cb-92af-41cf-bb88-f3674a1e4ee5 tempest-GroupsTest-1905039420 None] Created volume successfully. Sep 28 15:08:57 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359" returned: 0 in 0.497s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:57 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359 Sep 28 15:08:57 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:58 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312.98435001-039d-41e3-88c7-4ed367de3359" returned: 0 in 0.373s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Lock "cinder-quobyte-98435001-039d-41e3-88c7-4ed367de3359" released by "_delete_snapshot" :: held 2.782s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Lock "cinder-quobyte-5f17bb62-9838-45ef-81f7-c931ad674312" released by "delete_snapshot" :: held 2.834s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:58 devstack cinder-volume[86384]: WARNING cinder.quota [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1064225073 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1064225073, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:58 devstack cinder-volume[86384]: WARNING cinder.quota [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1064225073 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1064225073, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:58 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] Created reservations ['1adb4fee-4e70-4d60-ac52-c11007169d94', '64c7c614-b4b0-42a8-b2a8-2806302937d7', 'db1ee35d-afb1-4030-a8d6-b0dc8e5e4b62', '436baabe-87f6-466e-963d-f556546bc1fb'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-97de300f-3d33-4960-b3c1-18b88c31ecf4 tempest-GroupSnapshotsV319Test-944071237 None] group_snapshot da66dc8c-8263-4886-945c-bd10e48af8d8: deleted successfully Sep 28 15:08:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7f100fe4-9afc-4fee-873e-a0b3b136e561 tempest-VolumesActionsTest-1017232961 None] Acquiring lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8" by "attach_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7f100fe4-9afc-4fee-873e-a0b3b136e561 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8" acquired by "attach_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7f100fe4-9afc-4fee-873e-a0b3b136e561 tempest-VolumesActionsTest-1017232961 None] Attaching volume f2432321-3f8b-4f33-8f6e-83ca461e43a8 to instance c99326da-80cb-4500-b233-33f921b0c593 at mountpoint /dev/vdb on host None. Sep 28 15:08:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7f100fe4-9afc-4fee-873e-a0b3b136e561 tempest-VolumesActionsTest-1017232961 None] Attach volume completed successfully. Sep 28 15:08:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7f100fe4-9afc-4fee-873e-a0b3b136e561 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8" released by "attach_volume" :: held 0.139s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Acquiring lock "cinder-quobyte-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Lock "cinder-quobyte-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0" acquired by "delete_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedd0752-45ef-42c7-9206-732c8a639d8f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-77d7edad-2e52-4f60-8f4e-3ec2ca2580e2 tempest-VolumesActionsTest-1017232961 None] Acquiring lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-detach_volume" by "detach_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-77d7edad-2e52-4f60-8f4e-3ec2ca2580e2 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-77d7edad-2e52-4f60-8f4e-3ec2ca2580e2 tempest-VolumesActionsTest-1017232961 None] Detaching volume f2432321-3f8b-4f33-8f6e-83ca461e43a8 from instance c99326da-80cb-4500-b233-33f921b0c593. Sep 28 15:08:59 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 Sep 28 15:08:59 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-77d7edad-2e52-4f60-8f4e-3ec2ca2580e2 tempest-VolumesActionsTest-1017232961 None] Detach volume completed successfully. Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-77d7edad-2e52-4f60-8f4e-3ec2ca2580e2 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:59 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0" returned: 0 in 0.668s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:59 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0 Sep 28 15:08:59 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Acquiring lock "cinder-quobyte-5f17bb62-9838-45ef-81f7-c931ad674312" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Lock "cinder-quobyte-5f17bb62-9838-45ef-81f7-c931ad674312" acquired by "delete_volume" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:00 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef36742-c35f-4b95-b5ff-3b90230a8f06]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:00 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0" returned: 0 in 0.768s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:00 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 Sep 28 15:09:00 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Lock "cinder-quobyte-fbb05bdf-c5f2-4a9b-959e-48f7e33c02c0" released by "delete_volume" :: held 1.589s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:00 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Created reservations ['0c52ea84-cb23-4e47-9e5e-e3e2ebba4904'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:00 devstack cinder-volume[86384]: WARNING cinder.quota [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2040524961 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2040524961, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:00 devstack cinder-volume[86384]: WARNING cinder.quota [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2040524961 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2040524961, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Created reservations ['cf7e5c2b-7a45-4577-a788-7b33e2a51beb', 'b40042df-b301-48b5-9344-bc8206a995c6', 'dedc7ba9-a8de-4dff-9af6-058aefd84176', 'c31f5b67-ecce-43b9-a869-b3e6e67e2a9b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:01 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:09:01 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:01 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312" returned: 0 in 0.953s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:01 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312 Sep 28 15:09:01 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:01 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.320s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-784f05d6-5c8d-4d5c-a26b-5cb6a5dd4024 tempest-GroupsTest-1905039420 None] Delete group completed successfully. Sep 28 15:09:01 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5f17bb62-9838-45ef-81f7-c931ad674312" returned: 0 in 0.362s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Lock "cinder-quobyte-5f17bb62-9838-45ef-81f7-c931ad674312" released by "delete_volume" :: held 1.449s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Created reservations ['94afeb3a-03bf-44e7-a7a0-2c8b654e0e6f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:01 devstack cinder-volume[86384]: WARNING cinder.quota [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1064225073 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1064225073, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Created reservations ['545f9f2d-ce2c-4814-8370-5f28ee0963f8', '1f6e633a-83b8-4f27-8bdf-c536b6b9ff70', 'e3dc4239-3dd3-47a8-9a1a-f38660a34dc2', 'b53fcb86-8ad0-449a-a4f8-449740fd181f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:02 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:09:02 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Created reservations ['96217f3c-def6-471b-ad05-35e4e4ad401d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:02 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:09:02 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:02 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.475s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-223640d2-c1a8-4606-b966-c56ed0015fcd tempest-GroupSnapshotsV319Test-944071237 None] Delete group completed successfully. Sep 28 15:09:02 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.336s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:02 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ad4e5678-28ae-45c0-8c28-b0a3e9e0f989 tempest-GroupsTest-1905039420 None] Delete group completed successfully. Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Flow 'volume_create_manager' (08c2e4bb-0836-447d-a09c-4fe3eb37d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7e207-a653-4a2d-a748-39e466da883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7e207-a653-4a2d-a748-39e466da883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-591906664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512795b8-9916-41d6-83bc-8fec1c7135a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e02d05ce2b41ecadf4ab23b6c81920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:04Z,use_quota=True,user_id='dcac3a8a279a427fb2154c05804273c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256bd489-7074-4a7b-885b-8bf62215e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256bd489-7074-4a7b-885b-8bf62215e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2feb787-df77-41dd-bdf3-942a31306a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2feb787-df77-41dd-bdf3-942a31306a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512795b8-9916-41d6-83bc-8fec1c7135a8', 'volume_name': 'volume-512795b8-9916-41d6-83bc-8fec1c7135a8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a412da71-e738-4cc5-b561-b81c652f3742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a412da71-e738-4cc5-b561-b81c652f3742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a90ea75-811c-4da3-aa43-06dcf2b3c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Volume 512795b8-9916-41d6-83bc-8fec1c7135a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512795b8-9916-41d6-83bc-8fec1c7135a8', 'volume_size': 1} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-591906664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512795b8-9916-41d6-83bc-8fec1c7135a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e02d05ce2b41ecadf4ab23b6c81920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:04Z,use_quota=True,user_id='dcac3a8a279a427fb2154c05804273c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Creating volume 512795b8-9916-41d6-83bc-8fec1c7135a8 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:04 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:04 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 1073741824 Sep 28 15:09:04 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9506230a-f79d-4863-82dc-53771dc1d187 tempest-GroupsTest-1905039420 None] Group tempest-GroupsTest-Group-835919218: creating Sep 28 15:09:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9506230a-f79d-4863-82dc-53771dc1d187 tempest-GroupsTest-1905039420 None] Group tempest-GroupsTest-Group-835919218: created successfully Sep 28 15:09:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9506230a-f79d-4863-82dc-53771dc1d187 tempest-GroupsTest-1905039420 None] Create group completed successfully. Sep 28 15:09:04 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 1073741824" returned: 0 in 0.719s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:05 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 Sep 28 15:09:05 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:05 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8" returned: 0 in 0.410s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a90ea75-811c-4da3-aa43-06dcf2b3c68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512795b8-9916-41d6-83bc-8fec1c7135a8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7568c80-7bc9-4f1e-a871-ec0bbf76f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Volume volume-512795b8-9916-41d6-83bc-8fec1c7135a8 (512795b8-9916-41d6-83bc-8fec1c7135a8): created successfully Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7568c80-7bc9-4f1e-a871-ec0bbf76f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Flow 'volume_create_manager' (08c2e4bb-0836-447d-a09c-4fe3eb37d158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b7e5fed1-dfb4-41ca-a606-e5b47b64969d tempest-VolumesTransfersTest-686004966 None] Created volume successfully. Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Flow 'volume_create_manager' (258348ec-58b9-4896-90b5-ce89d94c8938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49988b21-a776-4ce3-afa3-f06701e35b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49988b21-a776-4ce3-afa3-f06701e35b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279075068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb2e4f21-4eb8-4589-9050-08153f89d133,host='devstack@QuobyteHD#QuobyteHD',id=1b1a6277-4f34-4dda-ad57-43c75b723b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf5c8725d64fa880eee6f8f430ebdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:07Z,use_quota=True,user_id='09a0b49e21814d77b67ccb3332d46dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed1b3ce6-8770-4f7d-b8d8-030d866263b6),volume_type_id=ed1b3ce6-8770-4f7d-b8d8-030d866263b6)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43065165-c2c7-4fb0-b333-468846b40fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43065165-c2c7-4fb0-b333-468846b40fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6e674f-1039-4e77-8108-0891487dfb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6e674f-1039-4e77-8108-0891487dfb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1a6277-4f34-4dda-ad57-43c75b723b35', 'volume_name': 'volume-1b1a6277-4f34-4dda-ad57-43c75b723b35', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3456cf-4f49-47d8-8b08-2da8a347f37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3456cf-4f49-47d8-8b08-2da8a347f37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b7a77d-54f6-4392-9ff9-4da579a733b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Volume 1b1a6277-4f34-4dda-ad57-43c75b723b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1a6277-4f34-4dda-ad57-43c75b723b35', 'volume_size': 1} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb2e4f21-4eb8-4589-9050-08153f89d133,created_at=2026-09-28T13:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279075068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb2e4f21-4eb8-4589-9050-08153f89d133,host='devstack@QuobyteHD#QuobyteHD',id=1b1a6277-4f34-4dda-ad57-43c75b723b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf5c8725d64fa880eee6f8f430ebdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:07Z,use_quota=True,user_id='09a0b49e21814d77b67ccb3332d46dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed1b3ce6-8770-4f7d-b8d8-030d866263b6),volume_type_id=ed1b3ce6-8770-4f7d-b8d8-030d866263b6)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Creating volume 1b1a6277-4f34-4dda-ad57-43c75b723b35 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:06 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:09:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:07 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 1073741824 Sep 28 15:09:07 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:08 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 1073741824" returned: 0 in 1.098s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:08 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 Sep 28 15:09:08 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2f7abd50-af0e-43d7-ad27-837aadffb85f tempest-VolumesTransfersTest-717642363 None] Transfer volume completed successfully. Sep 28 15:09:08 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35" returned: 0 in 0.434s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b7a77d-54f6-4392-9ff9-4da579a733b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1a6277-4f34-4dda-ad57-43c75b723b35', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a7904-7edf-43f4-9f0b-f5faa2264371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Volume volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 (1b1a6277-4f34-4dda-ad57-43c75b723b35): created successfully Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a7904-7edf-43f4-9f0b-f5faa2264371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Flow 'volume_create_manager' (258348ec-58b9-4896-90b5-ce89d94c8938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2569292b-2471-4eaf-8de6-58ef8b0f3467 tempest-GroupsTest-1905039420 None] Created volume successfully. Sep 28 15:09:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Acquiring lock "cinder-512795b8-9916-41d6-83bc-8fec1c7135a8-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-512795b8-9916-41d6-83bc-8fec1c7135a8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Acquiring lock "cinder-quobyte-512795b8-9916-41d6-83bc-8fec1c7135a8" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-quobyte-512795b8-9916-41d6-83bc-8fec1c7135a8" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b106c40-e728-4d6d-8cf2-16052aebdda5]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:09 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 Sep 28 15:09:09 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:10 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8" returned: 0 in 0.648s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:10 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8 Sep 28 15:09:10 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Flow 'volume_create_manager' (cb8d57b8-533e-4426-9d56-ad4df169802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f5beb0-398d-4f66-9714-90b242d63f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f5beb0-398d-4f66-9714-90b242d63f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884745803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb2e4f21-4eb8-4589-9050-08153f89d133,host='devstack@QuobyteHD#QuobyteHD',id=e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf5c8725d64fa880eee6f8f430ebdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:10Z,use_quota=True,user_id='09a0b49e21814d77b67ccb3332d46dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed1b3ce6-8770-4f7d-b8d8-030d866263b6),volume_type_id=ed1b3ce6-8770-4f7d-b8d8-030d866263b6)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a79d78-3321-4c16-a084-6c7c298522cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a79d78-3321-4c16-a084-6c7c298522cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e08629e-c827-4c4a-b82e-ecac259baf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e08629e-c827-4c4a-b82e-ecac259baf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea', 'volume_name': 'volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c303f5-7125-4519-a779-29f2e8f9bcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c303f5-7125-4519-a779-29f2e8f9bcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d27466-1d22-4b72-a59f-3f71d8a4c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:10 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Volume e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea', 'volume_size': 1} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb2e4f21-4eb8-4589-9050-08153f89d133,created_at=2026-09-28T13:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884745803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb2e4f21-4eb8-4589-9050-08153f89d133,host='devstack@QuobyteHD#QuobyteHD',id=e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf5c8725d64fa880eee6f8f430ebdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:10Z,use_quota=True,user_id='09a0b49e21814d77b67ccb3332d46dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed1b3ce6-8770-4f7d-b8d8-030d866263b6),volume_type_id=ed1b3ce6-8770-4f7d-b8d8-030d866263b6)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Creating volume e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:10 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:10 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea 1073741824 Sep 28 15:09:10 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:10 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-512795b8-9916-41d6-83bc-8fec1c7135a8" returned: 0 in 0.494s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-quobyte-512795b8-9916-41d6-83bc-8fec1c7135a8" released by "delete_volume" :: held 1.223s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:10 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Created reservations ['fbf02044-0ce7-4aa8-bb25-30b5f33861c6', '61c62475-784d-463c-b6df-f836a7cac9c2', '4f026924-efda-4f37-8cf9-243736aee68f', '9dd83438-b674-4783-891a-46b8cf1fb97d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:11 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:09:11 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:11 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.447s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Deleted volume successfully. Sep 28 15:09:11 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea 1073741824" returned: 0 in 0.912s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6565eec1-8573-434a-bdc1-6bfcdcab5ccd tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-512795b8-9916-41d6-83bc-8fec1c7135a8-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:11 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea Sep 28 15:09:11 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea" returned: 0 in 0.479s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:12 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d27466-1d22-4b72-a59f-3f71d8a4c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fbab68-50a9-4129-a23a-c1700f44fed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Volume volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea (e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea): created successfully Sep 28 15:09:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fbab68-50a9-4129-a23a-c1700f44fed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Flow 'volume_create_manager' (cb8d57b8-533e-4426-9d56-ad4df169802f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-81a84716-3e4e-4204-bccf-99bc885f952b tempest-GroupsTest-1905039420 None] Created volume successfully. Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Flow 'volume_create_manager' (d49cf3cf-08c9-45c9-a4ff-39c026492677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd953985-0c86-49dd-b4ce-45b2e489f7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd953985-0c86-49dd-b4ce-45b2e489f7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-779510449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414c0fdb-1a72-420c-bb30-19477a316f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e02d05ce2b41ecadf4ab23b6c81920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:13Z,use_quota=True,user_id='dcac3a8a279a427fb2154c05804273c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b624ac6d-70a4-4ebb-9cde-97852837f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b624ac6d-70a4-4ebb-9cde-97852837f961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d057060e-d4b1-4f7f-a1be-0ac5c7a65377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d057060e-d4b1-4f7f-a1be-0ac5c7a65377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414c0fdb-1a72-420c-bb30-19477a316f5e', 'volume_name': 'volume-414c0fdb-1a72-420c-bb30-19477a316f5e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3ab9eb-a3c2-4b87-848d-33562abd42e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3ab9eb-a3c2-4b87-848d-33562abd42e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2880ddf2-91d2-430a-9c76-f4fc541f5ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:13 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Volume 414c0fdb-1a72-420c-bb30-19477a316f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414c0fdb-1a72-420c-bb30-19477a316f5e', 'volume_size': 1} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-779510449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414c0fdb-1a72-420c-bb30-19477a316f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e02d05ce2b41ecadf4ab23b6c81920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:13Z,use_quota=True,user_id='dcac3a8a279a427fb2154c05804273c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Creating volume 414c0fdb-1a72-420c-bb30-19477a316f5e {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:13 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:09:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:13 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e 1073741824 Sep 28 15:09:13 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:13 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-84ecebb2-b6b9-4354-af13-925e28d39758 tempest-GroupsTest-1905039420 None] Update group completed successfully. Sep 28 15:09:14 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e 1073741824" returned: 0 in 0.879s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:14 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e Sep 28 15:09:14 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:15 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e" returned: 0 in 0.601s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2880ddf2-91d2-430a-9c76-f4fc541f5ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414c0fdb-1a72-420c-bb30-19477a316f5e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3745a228-0112-41f6-bd60-16a78c2db6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:15 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Volume volume-414c0fdb-1a72-420c-bb30-19477a316f5e (414c0fdb-1a72-420c-bb30-19477a316f5e): created successfully Sep 28 15:09:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3745a228-0112-41f6-bd60-16a78c2db6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Flow 'volume_create_manager' (d49cf3cf-08c9-45c9-a4ff-39c026492677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5b2b3430-62c1-41a3-93c3-8e57ccf6aa37 tempest-VolumesTransfersTest-686004966 None] Created volume successfully. Sep 28 15:09:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c48e61b2-cecf-4fb5-9cb8-61c07f4605f2 tempest-GroupsTest-1905039420 None] Update group completed successfully. Sep 28 15:09:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-099da4d4-b815-45ba-bc66-a02f0bd547c2 tempest-VolumesActionsTest-1017232961 None] Acquiring lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8" by "attach_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-099da4d4-b815-45ba-bc66-a02f0bd547c2 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8" acquired by "attach_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-099da4d4-b815-45ba-bc66-a02f0bd547c2 tempest-VolumesActionsTest-1017232961 None] Attaching volume f2432321-3f8b-4f33-8f6e-83ca461e43a8 to instance 76bb4c5f-dcb9-47d8-9bf1-d8f3384c10c0 at mountpoint /dev/vdb on host None. Sep 28 15:09:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-099da4d4-b815-45ba-bc66-a02f0bd547c2 tempest-VolumesActionsTest-1017232961 None] Attach volume completed successfully. Sep 28 15:09:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-099da4d4-b815-45ba-bc66-a02f0bd547c2 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8" released by "attach_volume" :: held 0.161s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2ab8037e-1941-4d99-943f-a5d050aa0653 tempest-VolumesActionsTest-1017232961 None] Acquiring lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-detach_volume" by "detach_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2ab8037e-1941-4d99-943f-a5d050aa0653 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2ab8037e-1941-4d99-943f-a5d050aa0653 tempest-VolumesActionsTest-1017232961 None] Detaching volume f2432321-3f8b-4f33-8f6e-83ca461e43a8 from instance 76bb4c5f-dcb9-47d8-9bf1-d8f3384c10c0. Sep 28 15:09:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2ab8037e-1941-4d99-943f-a5d050aa0653 tempest-VolumesActionsTest-1017232961 None] Detach volume completed successfully. Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2ab8037e-1941-4d99-943f-a5d050aa0653 tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-detach_volume" released by "detach_volume" :: held 0.234s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Acquiring lock "cinder-414c0fdb-1a72-420c-bb30-19477a316f5e-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-414c0fdb-1a72-420c-bb30-19477a316f5e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Acquiring lock "cinder-quobyte-414c0fdb-1a72-420c-bb30-19477a316f5e" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Acquiring lock "cinder-quobyte-1b1a6277-4f34-4dda-ad57-43c75b723b35" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-quobyte-414c0fdb-1a72-420c-bb30-19477a316f5e" acquired by "delete_volume" :: waited 0.071s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Lock "cinder-quobyte-1b1a6277-4f34-4dda-ad57-43c75b723b35" acquired by "delete_volume" :: waited 0.094s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ce5ac6-250a-4202-acb7-58cc456c0c24]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f2ad8-b4f9-4279-a998-086df6bed132]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 Sep 28 15:09:18 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e Sep 28 15:09:18 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e" returned: 0 in 0.714s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35" returned: 0 in 0.698s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e Sep 28 15:09:18 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35 Sep 28 15:09:18 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b1a6277-4f34-4dda-ad57-43c75b723b35" returned: 0 in 0.424s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Lock "cinder-quobyte-1b1a6277-4f34-4dda-ad57-43c75b723b35" released by "delete_volume" :: held 1.242s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Acquiring lock "cinder-quobyte-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Lock "cinder-quobyte-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea" acquired by "delete_volume" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf04b26-fb11-45cc-980e-f2b66ad83974]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-414c0fdb-1a72-420c-bb30-19477a316f5e" returned: 0 in 0.609s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-quobyte-414c0fdb-1a72-420c-bb30-19477a316f5e" released by "delete_volume" :: held 1.457s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:19 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea Sep 28 15:09:19 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Created reservations ['5c921071-1e45-4681-8bc0-fc7d715072e5', 'fc7561e9-3cf9-4d62-8a56-5899d323c220', '06e0c173-a758-4ad6-ac4c-5ad0ebe89d3d', '1b342def-be06-4f3a-a897-115977bfcf61'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:09:19 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea" returned: 0 in 0.595s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea Sep 28 15:09:19 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:20 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.440s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Deleted volume successfully. Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c56a3d6e-3f4b-4fa5-91cc-a3edc791a883 tempest-VolumesTransfersTest-2058243732 None] Lock "cinder-414c0fdb-1a72-420c-bb30-19477a316f5e-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea" returned: 0 in 0.505s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Lock "cinder-quobyte-e23a2eb2-08b9-496c-8d4f-ef91cf2a0bea" released by "delete_volume" :: held 1.197s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Created reservations ['8ef83c99-ed65-4fc9-ba8d-6c388710acc9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:20 devstack cinder-volume[86384]: WARNING cinder.quota [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1896623038 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1896623038, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:20 devstack cinder-volume[86384]: WARNING cinder.quota [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1896623038 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1896623038, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Created reservations ['81127a7a-c158-4167-ba58-c66e7151d87a', 'dc059f85-1394-43a9-a563-6a21040483fd', '332f5cc2-2290-40a3-8f9e-32b79fffc220', 'a489a30b-6001-4449-97ed-6a0206de46a4'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Created reservations ['65b0c1cd-53d3-4e46-a63a-773df63d9a94', '7787699e-1d37-493c-b6c7-8cf57d4e1a5e', '6a13b3c0-e0a3-4e72-9e34-08174abce31e', '95b3a5ce-8869-40c7-9748-989a65e011e1'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:21 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:09:21 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:21 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.435s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-acaf54f0-6291-45cf-a9f4-2eb709d5730e tempest-GroupsTest-1905039420 None] Delete group completed successfully. Sep 28 15:09:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:24 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9052691c-aba2-4259-ac09-eb0d787dfa9f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:25 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:09:25 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:25 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.625s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae86b3c-9bf7-47c6-9742-dd68a172e055]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:25 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:09:25 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:26 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.628s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.63f86f84-d0a3-48af-adf0-243e9afe67dcbbnklvr9.img {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:26 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.63f86f84-d0a3-48af-adf0-243e9afe67dcbbnklvr9.img Sep 28 15:09:26 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:31 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=94,cinder:UPDATE=102,cinder:DELETE=3,cinder:INSERT=22 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:33 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:09:33 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:34 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.768s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:09:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:09:34 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=97,cinder:SELECT=97,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:35 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.63f86f84-d0a3-48af-adf0-243e9afe67dcbbnklvr9.img" returned: 0 in 9.260s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391cbea-f8b2-4f17-9f29-50fdb79580d6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:35 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:09:35 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Flow 'volume_create_manager' (7b5f195b-ae2a-48bb-a1ed-817c794bd525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58c88bd-fc56-4229-a4b5-36a9b030d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58c88bd-fc56-4229-a4b5-36a9b030d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1598115085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bf6774-42d6-489f-814c-1315d62aca12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf3f119dbdd459d8c07b51832bb1921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:35Z,use_quota=True,user_id='536f565ad36d46a7bdc6b1bdd1243e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b2e083-9a72-4996-b23a-8bb91b6394fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b2e083-9a72-4996-b23a-8bb91b6394fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33149ee2-85a3-48e4-bb62-4cd17e4b7006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33149ee2-85a3-48e4-bb62-4cd17e4b7006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44bf6774-42d6-489f-814c-1315d62aca12', 'volume_name': 'volume-44bf6774-42d6-489f-814c-1315d62aca12', 'volume_size': 2}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1efde5a-df57-4380-83df-9480a881c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1efde5a-df57-4380-83df-9480a881c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d18c86-4d60-4f6d-9234-5d0353a7e3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Volume 44bf6774-42d6-489f-814c-1315d62aca12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44bf6774-42d6-489f-814c-1315d62aca12', 'volume_size': 2} Sep 28 15:09:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:36 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.681s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8, size 1024.00 MB, duration 9.26 sec, destination /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.63f86f84-d0a3-48af-adf0-243e9afe67dcbbnklvr9.img {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:09:36 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Converted 1024.00 MB image at 110.56 MB/s Sep 28 15:09:36 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] 63f86f84-d0a3-48af-adf0-243e9afe67dc was raw, no need to convert to raw {{(pid=86384) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:09:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-01779fbe-a60e-4c6d-a63f-4032f8287fb1 tempest-GroupsV314Test-506339622 None] Group tempest-GroupsV314Test-Group-1898780264: creating Sep 28 15:09:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-01779fbe-a60e-4c6d-a63f-4032f8287fb1 tempest-GroupsV314Test-506339622 None] Group tempest-GroupsV314Test-Group-1898780264: created successfully Sep 28 15:09:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-01779fbe-a60e-4c6d-a63f-4032f8287fb1 tempest-GroupsV314Test-506339622 None] Create group completed successfully. Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Flow 'volume_create_manager' (1d65e4d9-c67f-45c8-b5c3-205d59169a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de5d286-cd4f-4c94-a4ed-58c6e32b7dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de5d286-cd4f-4c94-a4ed-58c6e32b7dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1721029891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05f81a2c-6fad-4baf-b52c-cfacdd746eb8,host='devstack@QuobyteHD#QuobyteHD',id=4b3635e5-f606-4a56-8820-f2d0b061e842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb103e558ad4d458d291240067b35e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:39Z,use_quota=True,user_id='8389dd1b84544d30bfc032d38074d0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20c6803a-2bff-43c1-ae26-a30bc04d8802),volume_type_id=20c6803a-2bff-43c1-ae26-a30bc04d8802)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c896475-ac12-4f94-82cb-a88e722c504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c896475-ac12-4f94-82cb-a88e722c504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247957b5-197b-45e4-8f40-8dacd528a90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247957b5-197b-45e4-8f40-8dacd528a90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3635e5-f606-4a56-8820-f2d0b061e842', 'volume_name': 'volume-4b3635e5-f606-4a56-8820-f2d0b061e842', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743fe600-35f0-4645-8bdc-2c57283d124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743fe600-35f0-4645-8bdc-2c57283d124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb484f1-0dc0-4b17-a4aa-44559e2dbeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Volume 4b3635e5-f606-4a56-8820-f2d0b061e842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3635e5-f606-4a56-8820-f2d0b061e842', 'volume_size': 1} Sep 28 15:09:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:46 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:48 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Flow 'volume_create_manager' (eafab07d-a57f-4e12-83d5-fffb21791016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a269db-03ee-4d2f-9c65-f940859da0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a269db-03ee-4d2f-9c65-f940859da0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1431504784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01c8009-a2d0-4bf2-9b32-c47b0f646634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493ba327903b429b83d16cf0f4e27814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:52Z,use_quota=True,user_id='ac127e68f8a3435a805b94a132fc0a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa5d958-f867-4c22-b339-342161ac920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa5d958-f867-4c22-b339-342161ac920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5801469d-1643-48cb-8acc-6f0c8ba29590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5801469d-1643-48cb-8acc-6f0c8ba29590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01c8009-a2d0-4bf2-9b32-c47b0f646634', 'volume_name': 'volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308d408b-0d19-49f8-a502-3231197c5723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308d408b-0d19-49f8-a502-3231197c5723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735c031f-6afc-4788-9f7f-179738872c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:51 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Volume d01c8009-a2d0-4bf2-9b32-c47b0f646634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634', 'volume_size': 1} Sep 28 15:09:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.325s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Uploaded volume to glance image-id: 63f86f84-d0a3-48af-adf0-243e9afe67dc. {{(pid=86384) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.401s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1598115085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bf6774-42d6-489f-814c-1315d62aca12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf3f119dbdd459d8c07b51832bb1921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:35Z,use_quota=True,user_id='536f565ad36d46a7bdc6b1bdd1243e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Creating volume 44bf6774-42d6-489f-814c-1315d62aca12 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:00 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 2147483648 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:00 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 2147483648 Sep 28 15:10:00 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-df96440e-e95c-4ab9-b8f9-9c4314028c11 tempest-VolumesActionsTest-1017232961 None] Copy volume to image completed successfully. Sep 28 15:10:00 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 2147483648" returned: 0 in 0.641s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:00 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 Sep 28 15:10:00 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:01 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12" returned: 0 in 0.330s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.393s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05f81a2c-6fad-4baf-b52c-cfacdd746eb8,created_at=2026-09-28T13:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1721029891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05f81a2c-6fad-4baf-b52c-cfacdd746eb8,host='devstack@QuobyteHD#QuobyteHD',id=4b3635e5-f606-4a56-8820-f2d0b061e842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb103e558ad4d458d291240067b35e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:39Z,use_quota=True,user_id='8389dd1b84544d30bfc032d38074d0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20c6803a-2bff-43c1-ae26-a30bc04d8802),volume_type_id=20c6803a-2bff-43c1-ae26-a30bc04d8802)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Creating volume 4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d18c86-4d60-4f6d-9234-5d0353a7e3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bf6774-42d6-489f-814c-1315d62aca12', 'volume_size': 2}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:01 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 1073741824 Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735a37fc-e2aa-4c04-85f2-df1784548781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:01 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Volume volume-44bf6774-42d6-489f-814c-1315d62aca12 (44bf6774-42d6-489f-814c-1315d62aca12): created successfully Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735a37fc-e2aa-4c04-85f2-df1784548781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Flow 'volume_create_manager' (7b5f195b-ae2a-48bb-a1ed-817c794bd525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c45b87da-4e6f-40e5-a02c-d38ef35ef672 tempest-VolumesCloneNegativeTest-284110212 None] Created volume successfully. Sep 28 15:10:01 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 1073741824" returned: 0 in 0.659s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:01 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 Sep 28 15:10:02 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Acquiring lock "cinder-44bf6774-42d6-489f-814c-1315d62aca12-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Lock "cinder-44bf6774-42d6-489f-814c-1315d62aca12-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Acquiring lock "cinder-quobyte-44bf6774-42d6-489f-814c-1315d62aca12" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Lock "cinder-quobyte-44bf6774-42d6-489f-814c-1315d62aca12" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e5799e-92e3-43bb-9dd1-af0f6c78ab9f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:02 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 Sep 28 15:10:02 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:02 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.502s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1431504784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01c8009-a2d0-4bf2-9b32-c47b0f646634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493ba327903b429b83d16cf0f4e27814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:52Z,use_quota=True,user_id='ac127e68f8a3435a805b94a132fc0a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Creating volume d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:02 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb484f1-0dc0-4b17-a4aa-44559e2dbeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3635e5-f606-4a56-8820-f2d0b061e842', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6796b5-ea59-4553-8fd9-234d25e06207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:02 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 1073741824 Sep 28 15:10:02 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Volume volume-4b3635e5-f606-4a56-8820-f2d0b061e842 (4b3635e5-f606-4a56-8820-f2d0b061e842): created successfully Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6796b5-ea59-4553-8fd9-234d25e06207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Flow 'volume_create_manager' (1d65e4d9-c67f-45c8-b5c3-205d59169a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-035801b9-7617-4eca-ba38-258bea9771cf tempest-GroupsV314Test-506339622 None] Created volume successfully. Sep 28 15:10:02 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12" returned: 0 in 0.434s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:02 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12 Sep 28 15:10:02 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:02 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44bf6774-42d6-489f-814c-1315d62aca12" returned: 0 in 0.282s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:02 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 1073741824" returned: 0 in 0.514s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Lock "cinder-quobyte-44bf6774-42d6-489f-814c-1315d62aca12" released by "delete_volume" :: held 0.769s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:02 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 Sep 28 15:10:02 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:02 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Created reservations ['84cb29f9-d179-4db7-8d52-d77b8e41ab0c', '80020ff7-94e7-4849-a12b-a140808934dc', '311f7c6f-d64d-4b70-9a1f-5b2af9021988', 'a1e95d9e-e32f-4e95-9e38-763c427a3e3b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:03 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:03 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:03 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634" returned: 0 in 0.345s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.111s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735c031f-6afc-4788-9f7f-179738872c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2077796a-f0d0-46e2-8a8d-116bc4fc7757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fdae76-8691-42e1-bf5e-0e50cdbf162f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Volume volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 (d01c8009-a2d0-4bf2-9b32-c47b0f646634): created successfully Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2077796a-f0d0-46e2-8a8d-116bc4fc7757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Flow 'volume_create_manager' (eafab07d-a57f-4e12-83d5-fffb21791016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:03 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8da80c83-bc80-48e6-aa85-f80f1413490e tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Created volume successfully. Sep 28 15:10:03 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:10:03 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:03 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.477s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:03 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Deleted volume successfully. Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a4b66b56-e9a0-46ad-963c-d3d4efffa75d tempest-VolumesCloneNegativeTest-284110212 None] Lock "cinder-44bf6774-42d6-489f-814c-1315d62aca12-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:03 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.535s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dbc84d-aa8c-4bd0-b543-5e9b5ac20262]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:04 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:10:04 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:04 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.500s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:04 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img Sep 28 15:10:04 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Flow 'volume_create_manager' (0476a6f4-bac5-49b9-97f0-c04d626b7ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d0d042-1560-43ad-a96d-300614e46a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d0d042-1560-43ad-a96d-300614e46a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-247394145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e38860b-65a2-4395-ac1d-44d3860c6dc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1534bc00c6c45a9914df9ad1967a6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:11Z,use_quota=True,user_id='f00ca62f586040d9b0bcd1c6a462d9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f563c253-b1b9-41be-96b6-d5aed392fd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f563c253-b1b9-41be-96b6-d5aed392fd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1491af84-8156-4236-bb97-1ecea208a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1491af84-8156-4236-bb97-1ecea208a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e38860b-65a2-4395-ac1d-44d3860c6dc5', 'volume_name': 'volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c7396c-4590-48e9-ac2e-73112406d349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c7396c-4590-48e9-ac2e-73112406d349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eabde32-b5f0-4549-8408-4548f08204d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Volume 3e38860b-65a2-4395-ac1d-44d3860c6dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5', 'volume_size': 1} Sep 28 15:10:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:12 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img" returned: 0 in 7.836s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8c6c9-aa33-4709-a8e1-cbe70596dbed]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:12 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:10:12 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:12 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.557s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:10:12 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Converted 1024.00 MB image at 130.64 MB/s Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] 4b20c217-cee5-4c91-b998-b1294afff314 was raw, converting to qcow2 {{(pid=86384) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f79c056-e904-4269-bc50-9768db599c6f]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:12 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img Sep 28 15:10:12 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:13 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img" returned: 0 in 0.345s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:13 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img Sep 28 15:10:13 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:13 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img" returned: 1 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img /opt/stack/data/cinder/conversion/vol_upload_2h8o8__7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:13 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img /opt/stack/data/cinder/conversion/vol_upload_2h8o8__7 Sep 28 15:10:13 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:13 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img /opt/stack/data/cinder/conversion/vol_upload_2h8o8__7" returned: 0 in 0.289s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Image conversion details: src /opt/stack/data/cinder/conversion/f2432321-3f8b-4f33-8f6e-83ca461e43a8.temp_image.4b20c217-cee5-4c91-b998-b1294afff314hmowloq6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2h8o8__7 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:10:13 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e2a0da-02c5-4285-a8bc-c0b33a747107]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2h8o8__7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:13 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2h8o8__7 Sep 28 15:10:13 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:14 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2h8o8__7" returned: 0 in 0.366s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.435s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Uploaded volume to glance image-id: 4b20c217-cee5-4c91-b998-b1294afff314. {{(pid=86384) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:10:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.701s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Creating offline snapshot 72bc1a28-d836-4cb8-8c4e-8e435e70bf9b of volume d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3b6188b9-f1ef-452d-bb94-024d054e705b tempest-VolumesActionsTest-1017232961 None] Copy volume to image completed successfully. Sep 28 15:10:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a235e-8aeb-40ce-a633-56ed17c0a0fa]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:15 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 Sep 28 15:10:15 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:16 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634" returned: 0 in 0.464s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:16 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b 1G Sep 28 15:10:16 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Acquiring lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:16 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b 1G" returned: 0 in 0.498s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:16 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b Sep 28 15:10:16 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Acquiring lock "cinder-quobyte-f2432321-3f8b-4f33-8f6e-83ca461e43a8" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Lock "cinder-quobyte-f2432321-3f8b-4f33-8f6e-83ca461e43a8" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[33968be0-2a35-4c07-8334-202a8bc2fe16]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:16 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:10:16 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" returned: 0 in 0.354s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b is being set with open permissions: ugo+rw Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b Sep 28 15:10:17 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.434s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8 Sep 28 15:10:17 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" returned: 0 in 0.298s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.info Sep 28 15:10:17 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2432321-3f8b-4f33-8f6e-83ca461e43a8" returned: 0 in 0.278s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Lock "cinder-quobyte-f2432321-3f8b-4f33-8f6e-83ca461e43a8" released by "delete_volume" :: held 0.780s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Created reservations ['f6dcb0bf-3d5b-4248-aee9-0373ecadcf3b', '5595aa1d-2978-484a-a568-42eab41e20bf', '08777061-0102-4b36-8a32-2ef38ea04737', 'aec6713c-da12-4da2-8c1d-8d79f6c0aedd'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:17 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.info" returned: 0 in 0.316s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.info is being set with open permissions: ugo+rw Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.info Sep 28 15:10:17 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:17 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:18 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.info" returned: 0 in 0.304s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.911s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:18 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Cloning volume 4b3635e5-f606-4a56-8820-f2d0b061e842 to volume 6919c090-1b56-4ca6-81b1-74bad6b7e51e Sep 28 15:10:18 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-72fdd06d-1626-45d5-ae42-b639241784b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Create snapshot completed successfully Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.327s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Creating offline snapshot 5091c280-6cc8-42d7-b2c2-4d72d0f5827a of volume 4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Deleted volume successfully. Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3d002-e3c2-42e4-a7f3-af8ada42a3a7]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-26f5b44f-d76e-48d9-931d-8d2133f3788c tempest-VolumesActionsTest-1017232961 None] Lock "cinder-f2432321-3f8b-4f33-8f6e-83ca461e43a8-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:18 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 Sep 28 15:10:18 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:18 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842" returned: 0 in 0.429s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:18 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a 1G Sep 28 15:10:18 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:19 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a 1G" returned: 0 in 0.511s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3635e5-f606-4a56-8820-f2d0b061e842 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3635e5-f606-4a56-8820-f2d0b061e842 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a Sep 28 15:10:19 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "cinder-72bc1a28-d836-4cb8-8c4e-8e435e70bf9b-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-72bc1a28-d836-4cb8-8c4e-8e435e70bf9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "cinder-quobyte-d01c8009-a2d0-4bf2-9b32-c47b0f646634" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-quobyte-d01c8009-a2d0-4bf2-9b32-c47b0f646634" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "cinder-quobyte-72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-quobyte-72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Deleting offline snapshot 72bc1a28-d836-4cb8-8c4e-8e435e70bf9b of volume d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] snapshot_file for this snap is: volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd3a4b-b223-46f9-8322-e89ebe6c5598]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3635e5-f606-4a56-8820-f2d0b061e842 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a" returned: 0 in 0.420s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:19 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a Sep 28 15:10:19 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:19 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b Sep 28 15:10:19 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:19 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a" returned: 0 in 0.331s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" returned: 0 in 0.440s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:19 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.info Sep 28 15:10:19 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a8d97-a2f3-4398-973f-277726f8f4f8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 Sep 28 15:10:20 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.info" returned: 0 in 0.302s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.info Sep 28 15:10:20 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634" returned: 0 in 0.553s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b Sep 28 15:10:20 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.info" returned: 0 in 0.361s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Acquiring lock "cinder-quobyte-6919c090-1b56-4ca6-81b1-74bad6b7e51e" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-6919c090-1b56-4ca6-81b1-74bad6b7e51e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] snapshot: 5091c280-6cc8-42d7-b2c2-4d72d0f5827a, volume: 6919c090-1b56-4ca6-81b1-74bad6b7e51e, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[96774bdb-13a1-4825-ac1b-376168ae7496]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a Sep 28 15:10:20 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" returned: 0 in 0.441s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b Sep 28 15:10:20 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a" returned: 0 in 0.458s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3635e5-f606-4a56-8820-f2d0b061e842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e28fc14-599e-487d-85ae-c45d27364262]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634.72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" returned: 0 in 0.297s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 Sep 28 15:10:21 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-quobyte-72bc1a28-d836-4cb8-8c4e-8e435e70bf9b" released by "_delete_snapshot" :: held 1.901s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-quobyte-d01c8009-a2d0-4bf2-9b32-c47b0f646634" released by "delete_snapshot" :: held 1.938s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Created reservations ['4470cfe3-747c-4af5-a9d4-891a0157cfd3', '9b9575df-5e34-465b-9421-0e7a0a12f458', 'eba6f476-b4be-486e-a6fb-674912ac5720', '9de688b7-6ab5-4e5b-9c5b-f2b5107ac987'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Delete snapshot completed successfully. Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-06edb0f4-7d02-4c9d-ad9d-bbdf0387b895 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-72bc1a28-d836-4cb8-8c4e-8e435e70bf9b-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:21 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842" returned: 0 in 0.560s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "cinder-d01c8009-a2d0-4bf2-9b32-c47b0f646634-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-d01c8009-a2d0-4bf2-9b32-c47b0f646634-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:21 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e Sep 28 15:10:21 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "cinder-quobyte-d01c8009-a2d0-4bf2-9b32-c47b0f646634" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-quobyte-d01c8009-a2d0-4bf2-9b32-c47b0f646634" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b88c12-c7d0-407c-a1cc-3107a89dac41]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:22 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 Sep 28 15:10:22 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:22 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634" returned: 0 in 0.433s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:22 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634 Sep 28 15:10:22 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:22 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d01c8009-a2d0-4bf2-9b32-c47b0f646634" returned: 0 in 0.495s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-quobyte-d01c8009-a2d0-4bf2-9b32-c47b0f646634" released by "delete_volume" :: held 1.033s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:23 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Created reservations ['6cf6f12c-68a6-4ef4-8c46-0f6b1b6472ae', '181ee615-fe5e-4fdc-82fc-7f86e5e41949', 'e0d7652c-142d-4b75-8425-7b9266bddce6', '3b17f042-d949-4881-8f56-b1fa3ccb4504'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:23 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:23 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:24 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 1.011s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:24 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Deleted volume successfully. Sep 28 15:10:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d6c7ace-dd3a-42d1-b47f-3dec3c33cf00 tempest-VolumeSnapshotQuotasNegativeTestJSON-724919252 None] Lock "cinder-d01c8009-a2d0-4bf2-9b32-c47b0f646634-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:30 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e" returned: 0 in 9.039s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:30 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:10:30 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Converted 1024.00 MB image at 113.27 MB/s Sep 28 15:10:30 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:10:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:30 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e Sep 28 15:10:30 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e" returned: 0 in 0.297s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-6919c090-1b56-4ca6-81b1-74bad6b7e51e" released by "_copy_volume_from_snapshot" :: held 10.460s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Acquiring lock "cinder-quobyte-5091c280-6cc8-42d7-b2c2-4d72d0f5827a" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-5091c280-6cc8-42d7-b2c2-4d72d0f5827a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Deleting offline snapshot 5091c280-6cc8-42d7-b2c2-4d72d0f5827a of volume 4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] snapshot_file for this snap is: volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac39fa1-9b22-432c-bdb3-8c5fd66026e9]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:31 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a Sep 28 15:10:31 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a" returned: 0 in 0.589s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3635e5-f606-4a56-8820-f2d0b061e842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[442aaae6-6383-4050-b4ea-e129c6fd3b62]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:31 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 Sep 28 15:10:31 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:32 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842" returned: 0 in 0.688s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:32 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a Sep 28 15:10:32 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (ecfef340-39ff-4b07-8aca-f399f199a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e57c2f1-325d-464b-9fd3-81bcef8fba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e57c2f1-325d-464b-9fd3-81bcef8fba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-481810157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db7788e-66ba-4c04-9ac0-e29d478dad70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:33Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162110e0-c4c9-49a4-a284-78a3a9353f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162110e0-c4c9-49a4-a284-78a3a9353f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d6934b-dca9-4b4b-9c85-37a38fb4d5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d6934b-dca9-4b4b-9c85-37a38fb4d5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db7788e-66ba-4c04-9ac0-e29d478dad70', 'volume_name': 'volume-0db7788e-66ba-4c04-9ac0-e29d478dad70', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d841d801-d7c9-4783-9fa0-ad88d3f6c10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d841d801-d7c9-4783-9fa0-ad88d3f6c10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa5407c-1b1f-42b9-8460-52fe0d5271b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:32 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Volume 0db7788e-66ba-4c04-9ac0-e29d478dad70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db7788e-66ba-4c04-9ac0-e29d478dad70', 'volume_size': 1} Sep 28 15:10:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:33 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a" returned: 0 in 0.501s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a Sep 28 15:10:33 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842.5091c280-6cc8-42d7-b2c2-4d72d0f5827a" returned: 0 in 0.353s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-5091c280-6cc8-42d7-b2c2-4d72d0f5827a" released by "_delete_snapshot" :: held 2.302s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.375s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.120s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-247394145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e38860b-65a2-4395-ac1d-44d3860c6dc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1534bc00c6c45a9914df9ad1967a6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:11Z,use_quota=True,user_id='f00ca62f586040d9b0bcd1c6a462d9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Creating volume 3e38860b-65a2-4395-ac1d-44d3860c6dc5 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:33 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 1073741824 Sep 28 15:10:33 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0f7b6042-c62b-4251-b71d-7b3edcf4b785 tempest-GroupsV314Test-506339622 None] Create group from source-group-05f81a2c-6fad-4baf-b52c-cfacdd746eb8 completed successfully. Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:33 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 1073741824" returned: 0 in 0.564s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.285s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 Sep 28 15:10:34 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5" returned: 0 in 0.309s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-481810157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db7788e-66ba-4c04-9ac0-e29d478dad70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:33Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Creating volume 0db7788e-66ba-4c04-9ac0-e29d478dad70 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:34 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eabde32-b5f0-4549-8408-4548f08204d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2383c796-e740-4d30-b0b6-46cc4e882059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:34 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 1073741824 Sep 28 15:10:34 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Volume volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 (3e38860b-65a2-4395-ac1d-44d3860c6dc5): created successfully Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2383c796-e740-4d30-b0b6-46cc4e882059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Flow 'volume_create_manager' (0476a6f4-bac5-49b9-97f0-c04d626b7ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:34 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-424a3bd0-33fe-4b1c-ae4a-654d599308c3 tempest-VolumesListTestJSON-282187040 None] Created volume successfully. Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Acquiring lock "cinder-quobyte-6919c090-1b56-4ca6-81b1-74bad6b7e51e" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-6919c090-1b56-4ca6-81b1-74bad6b7e51e" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad9ec7-9b4b-4b85-a02e-81c51d5b11db]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:35 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 1073741824" returned: 0 in 0.628s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:35 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e Sep 28 15:10:35 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 Sep 28 15:10:35 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70" returned: 0 in 0.362s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa5407c-1b1f-42b9-8460-52fe0d5271b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db7788e-66ba-4c04-9ac0-e29d478dad70', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914b03e0-c0a1-417f-9055-d6863e47ad2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Volume volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 (0db7788e-66ba-4c04-9ac0-e29d478dad70): created successfully Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914b03e0-c0a1-417f-9055-d6863e47ad2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:35 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (ecfef340-39ff-4b07-8aca-f399f199a950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e" returned: 0 in 0.591s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-409ec2f2-85fc-49f7-8daf-9c5c359abde4 tempest-VolumesGetTest-1619699062 None] Created volume successfully. Sep 28 15:10:35 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e Sep 28 15:10:35 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6919c090-1b56-4ca6-81b1-74bad6b7e51e" returned: 0 in 0.345s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-6919c090-1b56-4ca6-81b1-74bad6b7e51e" released by "delete_volume" :: held 1.005s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Created reservations ['2ab42a9e-6c3e-4bc8-b88c-a2f7cc58fd9b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:36 devstack cinder-volume[86384]: WARNING cinder.quota [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1137622140 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1137622140, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:10:36 devstack cinder-volume[86384]: WARNING cinder.quota [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1137622140 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1137622140, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Created reservations ['8d0252ca-fd1b-4826-95f2-3fd6be5e005f', 'f2aed357-3552-422b-bf36-61599c7d24d3', '7d277407-2193-4680-8649-4d00d00307f9', '96ba7523-68d9-46a8-af11-edffbc5631d8'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Flow 'volume_create_manager' (9b0b7da6-53dd-4697-9cc9-455cdd8a360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d3da7-9a39-440e-bdcc-05cc2bfd9b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d3da7-9a39-440e-bdcc-05cc2bfd9b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1843033623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0ba5c7-c397-4342-8e23-6bc9e191db4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1534bc00c6c45a9914df9ad1967a6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:36Z,use_quota=True,user_id='f00ca62f586040d9b0bcd1c6a462d9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c0f239-75f2-431b-9d7e-6785d32d6d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c0f239-75f2-431b-9d7e-6785d32d6d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89f4270-5673-4e0a-8b12-c22cf49c80b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89f4270-5673-4e0a-8b12-c22cf49c80b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0ba5c7-c397-4342-8e23-6bc9e191db4a', 'volume_name': 'volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbb4861-c138-411b-b3f8-2052930416d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbb4861-c138-411b-b3f8-2052930416d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90295690-fd0d-4814-a1a7-3b0d424600d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Volume bd0ba5c7-c397-4342-8e23-6bc9e191db4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a', 'volume_size': 1} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1843033623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0ba5c7-c397-4342-8e23-6bc9e191db4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1534bc00c6c45a9914df9ad1967a6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:36Z,use_quota=True,user_id='f00ca62f586040d9b0bcd1c6a462d9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Creating volume bd0ba5c7-c397-4342-8e23-6bc9e191db4a {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:36 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:36 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a 1073741824 Sep 28 15:10:36 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:36 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:36 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Flow 'volume_create_manager' (fbd3d265-d2bf-4e20-b16a-2077e077ad87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f70a69c-d2aa-450b-b47a-be35a920e10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f70a69c-d2aa-450b-b47a-be35a920e10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1664807393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa991a-5c33-48cf-984a-af95a2f017ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8efe7c670c49ac8779759a1d6e898b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:36Z,use_quota=True,user_id='a4eb0d5a129a47c9b0b165061d7e34d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(153c87a8-f7cf-426e-9dd8-20c881ba7565),volume_type_id=153c87a8-f7cf-426e-9dd8-20c881ba7565)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c43ebec-5180-4eff-8216-6e2926580e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c43ebec-5180-4eff-8216-6e2926580e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f120615-030d-453e-8f1e-be9b625a9765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f120615-030d-453e-8f1e-be9b625a9765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcfa991a-5c33-48cf-984a-af95a2f017ae', 'volume_name': 'volume-bcfa991a-5c33-48cf-984a-af95a2f017ae', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23991741-3656-4f3e-87be-c27a17d1581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23991741-3656-4f3e-87be-c27a17d1581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af69709c-3863-4dba-9342-472499e7aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:36 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Volume bcfa991a-5c33-48cf-984a-af95a2f017ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcfa991a-5c33-48cf-984a-af95a2f017ae', 'volume_size': 1} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:36 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.313s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9a7b9010-2f8c-4f83-95e1-782fb05e98a9 tempest-GroupsV314Test-506339622 None] Delete group completed successfully. Sep 28 15:10:36 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a 1073741824" returned: 0 in 0.640s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a Sep 28 15:10:37 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1664807393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa991a-5c33-48cf-984a-af95a2f017ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8efe7c670c49ac8779759a1d6e898b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:36Z,use_quota=True,user_id='a4eb0d5a129a47c9b0b165061d7e34d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(153c87a8-f7cf-426e-9dd8-20c881ba7565),volume_type_id=153c87a8-f7cf-426e-9dd8-20c881ba7565)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Creating volume bcfa991a-5c33-48cf-984a-af95a2f017ae {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:37 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae 1073741824 Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90295690-fd0d-4814-a1a7-3b0d424600d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:37 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c5f378-d222-47dd-8364-58c88a29f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:37 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Volume volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a (bd0ba5c7-c397-4342-8e23-6bc9e191db4a): created successfully Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c5f378-d222-47dd-8364-58c88a29f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Flow 'volume_create_manager' (9b0b7da6-53dd-4697-9cc9-455cdd8a360d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:37 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3328911a-be04-4295-b28e-dbadf80cf360 tempest-VolumesListTestJSON-282187040 None] Created volume successfully. Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (afdff4f3-69ee-4f30-9fd6-1f1c53d44336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b0061b-dd86-4585-8406-3965c2c5bd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b0061b-dd86-4585-8406-3965c2c5bd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915020111',display_name='tempest-VolumesGetTest-Volume-628416649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc07ea32-5067-4559-83b8-1b9aecb2a295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:38Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66da5b34-75ed-4ab0-8ede-5d6aa778a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66da5b34-75ed-4ab0-8ede-5d6aa778a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db895095-95ae-4e1f-8f21-3824fac7a3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db895095-95ae-4e1f-8f21-3824fac7a3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc07ea32-5067-4559-83b8-1b9aecb2a295', 'volume_name': 'volume-fc07ea32-5067-4559-83b8-1b9aecb2a295', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb3919d-9697-4a23-af3b-660ae141daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb3919d-9697-4a23-af3b-660ae141daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b7404b-d29f-477a-b882-551e9f037790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:37 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Volume fc07ea32-5067-4559-83b8-1b9aecb2a295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc07ea32-5067-4559-83b8-1b9aecb2a295', 'volume_size': 1} Sep 28 15:10:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Acquiring lock "cinder-quobyte-4b3635e5-f606-4a56-8820-f2d0b061e842" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-4b3635e5-f606-4a56-8820-f2d0b061e842" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a7f31-3d11-4c02-86a3-624dcc6df25b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae 1073741824" returned: 0 in 0.706s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 Sep 28 15:10:38 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae Sep 28 15:10:38 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842" returned: 0 in 0.498s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:38 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842 Sep 28 15:10:38 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915020111',display_name='tempest-VolumesGetTest-Volume-628416649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc07ea32-5067-4559-83b8-1b9aecb2a295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:38Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Creating volume fc07ea32-5067-4559-83b8-1b9aecb2a295 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:38 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 1073741824 Sep 28 15:10:38 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af69709c-3863-4dba-9342-472499e7aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcfa991a-5c33-48cf-984a-af95a2f017ae', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd5a06b-af7c-471e-bd8d-c8197b63d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:38 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Volume volume-bcfa991a-5c33-48cf-984a-af95a2f017ae (bcfa991a-5c33-48cf-984a-af95a2f017ae): created successfully Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd5a06b-af7c-471e-bd8d-c8197b63d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Flow 'volume_create_manager' (fbd3d265-d2bf-4e20-b16a-2077e077ad87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:38 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1b207865-f16c-4f0c-8d00-13fb7ca9ab30 tempest-VolumeTypesAccessTest-1113174754 None] Created volume successfully. Sep 28 15:10:38 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4b3635e5-f606-4a56-8820-f2d0b061e842" returned: 0 in 0.343s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Lock "cinder-quobyte-4b3635e5-f606-4a56-8820-f2d0b061e842" released by "delete_volume" :: held 0.946s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Flow 'volume_create_manager' (caba3c90-c531-4167-9e50-4f9705264ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03495065-5eee-40cf-ba4d-dac78ef57267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03495065-5eee-40cf-ba4d-dac78ef57267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-136868401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba5f1a7-3c60-4c1b-850f-640c3c97c2b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1534bc00c6c45a9914df9ad1967a6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:39Z,use_quota=True,user_id='f00ca62f586040d9b0bcd1c6a462d9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68e4962-1edc-469e-9538-39073abc6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68e4962-1edc-469e-9538-39073abc6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2343e704-5c79-473e-9faa-25f605ae4fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2343e704-5c79-473e-9faa-25f605ae4fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba5f1a7-3c60-4c1b-850f-640c3c97c2b6', 'volume_name': 'volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da75e4db-ad57-4409-b8a7-9f9fb80c5fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da75e4db-ad57-4409-b8a7-9f9fb80c5fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f3d76d-c53c-4320-aeca-010537c3e3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Volume eba5f1a7-3c60-4c1b-850f-640c3c97c2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6', 'volume_size': 1} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Created reservations ['16dd5b22-66ae-4f0b-8ad7-76c2a296931a'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Created reservations ['c5b65ece-7e33-4055-941c-8d13e138bc08', 'fe0adb22-1a4b-448f-8346-dc0491e70e39', '2ee8afe9-55d5-4cfd-ae69-cc57c2a0a86d', 'a3fac72e-cf27-4f24-a0de-9dca0ae3e913'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:39 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 1073741824" returned: 0 in 0.601s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:39 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 Sep 28 15:10:39 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:39 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:39 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:39 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295" returned: 0 in 0.324s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-136868401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba5f1a7-3c60-4c1b-850f-640c3c97c2b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1534bc00c6c45a9914df9ad1967a6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:39Z,use_quota=True,user_id='f00ca62f586040d9b0bcd1c6a462d9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Creating volume eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:39 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 1073741824 Sep 28 15:10:39 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b7404b-d29f-477a-b882-551e9f037790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc07ea32-5067-4559-83b8-1b9aecb2a295', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444fe86e-22cc-4306-8e90-1cd33b6906cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Volume volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 (fc07ea32-5067-4559-83b8-1b9aecb2a295): created successfully Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444fe86e-22cc-4306-8e90-1cd33b6906cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (afdff4f3-69ee-4f30-9fd6-1f1c53d44336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:39 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7fb1d668-7a1c-4571-8388-5936f1f23f32 tempest-VolumesGetTest-1619699062 None] Created volume successfully. Sep 28 15:10:39 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:39 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9c5f6466-1abe-4eac-8537-48606e0607f6 tempest-GroupsV314Test-506339622 None] Delete group completed successfully. Sep 28 15:10:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Acquiring lock "cinder-bcfa991a-5c33-48cf-984a-af95a2f017ae-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Lock "cinder-bcfa991a-5c33-48cf-984a-af95a2f017ae-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Acquiring lock "cinder-quobyte-bcfa991a-5c33-48cf-984a-af95a2f017ae" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Lock "cinder-quobyte-bcfa991a-5c33-48cf-984a-af95a2f017ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ebd20-5143-4142-adc3-057f97e24196]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae Sep 28 15:10:40 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 1073741824" returned: 0 in 0.669s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 Sep 28 15:10:40 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae" returned: 0 in 0.458s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae Sep 28 15:10:40 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6" returned: 0 in 0.374s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f3d76d-c53c-4320-aeca-010537c3e3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de074b2-c580-4716-86b3-f0cc78c7798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:40 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Volume volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 (eba5f1a7-3c60-4c1b-850f-640c3c97c2b6): created successfully Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de074b2-c580-4716-86b3-f0cc78c7798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Flow 'volume_create_manager' (caba3c90-c531-4167-9e50-4f9705264ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:40 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-05f865b5-c558-4853-8170-ae65b2dd057b tempest-VolumesListTestJSON-282187040 None] Created volume successfully. Sep 28 15:10:40 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bcfa991a-5c33-48cf-984a-af95a2f017ae" returned: 0 in 0.367s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Lock "cinder-quobyte-bcfa991a-5c33-48cf-984a-af95a2f017ae" released by "delete_volume" :: held 0.884s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:41 devstack cinder-volume[86384]: WARNING cinder.quota [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-100792663 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-100792663, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:10:41 devstack cinder-volume[86384]: WARNING cinder.quota [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-100792663 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-100792663, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Created reservations ['aef20f46-5c63-4a36-9071-dd284b69d7d1', '2a20efcb-8ff8-4e26-aab9-bc1496b6f91f', 'b938412d-ea4f-4416-90af-fb4bc0d20bc7', '956052a9-1f81-4ba1-b866-5f3bcbf7e798'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-fc07ea32-5067-4559-83b8-1b9aecb2a295-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Lock "cinder-fc07ea32-5067-4559-83b8-1b9aecb2a295-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-fc07ea32-5067-4559-83b8-1b9aecb2a295" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:41 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-fc07ea32-5067-4559-83b8-1b9aecb2a295" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:41 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d53c98-1a78-4bf2-8bc9-84a6d1a76de8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:41 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 Sep 28 15:10:41 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:41 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.457s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Deleted volume successfully. Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef95d185-5386-43b3-850c-29be1d835bdb tempest-VolumeTypesAccessTest-1113174754 None] Lock "cinder-bcfa991a-5c33-48cf-984a-af95a2f017ae-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:41 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295" returned: 0 in 0.644s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:42 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295 Sep 28 15:10:42 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:42 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fc07ea32-5067-4559-83b8-1b9aecb2a295" returned: 0 in 0.369s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-fc07ea32-5067-4559-83b8-1b9aecb2a295" released by "delete_volume" :: held 1.103s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Created reservations ['947e6fdd-2de6-47d8-a719-92333b07a5f2', 'cadaddd4-613f-431d-a7ef-e4faad593a24', '56ee51a3-d4f7-4a63-af3b-39cc9d50cf35', '36eed95d-cdbf-404b-af91-38709140da89'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:42 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:42 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:42 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.356s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Deleted volume successfully. Sep 28 15:10:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-71e3aa38-9a30-4ef4-b2a4-d394b0a82c9b tempest-VolumesGetTest-1619699062 None] Lock "cinder-fc07ea32-5067-4559-83b8-1b9aecb2a295-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-0db7788e-66ba-4c04-9ac0-e29d478dad70-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Lock "cinder-0db7788e-66ba-4c04-9ac0-e29d478dad70-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-0db7788e-66ba-4c04-9ac0-e29d478dad70" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-0db7788e-66ba-4c04-9ac0-e29d478dad70" acquired by "delete_volume" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24bf727-1969-4572-9d1b-bfa6a0a47938]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:43 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 Sep 28 15:10:43 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:44 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70" returned: 0 in 0.574s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:44 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70 Sep 28 15:10:44 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:44 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0db7788e-66ba-4c04-9ac0-e29d478dad70" returned: 0 in 0.347s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-0db7788e-66ba-4c04-9ac0-e29d478dad70" released by "delete_volume" :: held 1.014s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Created reservations ['ae0c8a64-e1b1-4d4b-8f24-6b01dae3eb70', 'e7fab16f-0a79-4bbc-83a9-5586d4f63574', 'd4d66702-665a-43e2-a0c5-649027720bee', 'd1f871b6-5864-4ebd-9758-facba21e963c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:44 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:44 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "cinder-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:45 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.423s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "cinder-quobyte-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Deleted volume successfully. Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-quobyte-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6" acquired by "delete_volume" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5db24bc5-a67f-438f-a95c-09a1cd50ece9 tempest-VolumesGetTest-1619699062 None] Lock "cinder-0db7788e-66ba-4c04-9ac0-e29d478dad70-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8291a074-f554-4683-997d-a3e2d534f9f3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:45 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 Sep 28 15:10:45 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:45 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6" returned: 0 in 0.537s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:46 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6 Sep 28 15:10:46 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:46 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6" returned: 0 in 0.406s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-quobyte-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6" released by "delete_volume" :: held 1.038s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Created reservations ['51e2cced-657f-4456-9516-fb13ab05993e', '55d45a73-48ce-406e-98c6-b98dc674f9a5', '43030889-2519-427e-bd5e-cde5cd3e5bc6', 'cc0a3d1e-3a75-4379-846a-e04b8b754105'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:46 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:46 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (ed0d4ad2-5829-4a1b-83a8-c86404379b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bcb8eb-8490-464b-b6c5-cf5166950925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bcb8eb-8490-464b-b6c5-cf5166950925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-738659425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9412f1-f65e-44d2-98a6-14fc35908630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:47Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5300b121-7c6b-4acb-940e-8b7f53025907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5300b121-7c6b-4acb-940e-8b7f53025907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c48fcb-1888-48ba-a2d1-c3e0bd55d9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c48fcb-1888-48ba-a2d1-c3e0bd55d9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9412f1-f65e-44d2-98a6-14fc35908630', 'volume_name': 'volume-4c9412f1-f65e-44d2-98a6-14fc35908630', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3407b968-a1f3-4df1-863e-790ed562fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3407b968-a1f3-4df1-863e-790ed562fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663e9526-b6af-44b0-b456-dafeec78be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Volume 4c9412f1-f65e-44d2-98a6-14fc35908630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9412f1-f65e-44d2-98a6-14fc35908630', 'volume_size': 1} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-738659425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9412f1-f65e-44d2-98a6-14fc35908630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:47Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Creating volume 4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:46 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:10:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:46 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 1073741824 Sep 28 15:10:46 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:47 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.358s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Deleted volume successfully. Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=108,cinder:SELECT=83,cinder:DELETE=10,cinder:INSERT=24 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-01f537b9-65b8-4d89-a3e8-add0116918b1 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-eba5f1a7-3c60-4c1b-850f-640c3c97c2b6-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:47 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 1073741824" returned: 0 in 0.617s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 Sep 28 15:10:47 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "cinder-bd0ba5c7-c397-4342-8e23-6bc9e191db4a-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-bd0ba5c7-c397-4342-8e23-6bc9e191db4a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "cinder-quobyte-bd0ba5c7-c397-4342-8e23-6bc9e191db4a" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-quobyte-bd0ba5c7-c397-4342-8e23-6bc9e191db4a" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:47 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630" returned: 0 in 0.392s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663e9526-b6af-44b0-b456-dafeec78be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9412f1-f65e-44d2-98a6-14fc35908630', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5d4678-43ca-4bc4-8720-5b7e17a42f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae62418-cd34-41e2-8732-faa720c252f4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Volume volume-4c9412f1-f65e-44d2-98a6-14fc35908630 (4c9412f1-f65e-44d2-98a6-14fc35908630): created successfully Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5d4678-43ca-4bc4-8720-5b7e17a42f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (ed0d4ad2-5829-4a1b-83a8-c86404379b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:48 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3df56570-8380-455c-9f25-312f58670806 tempest-VolumesGetTest-1619699062 None] Created volume successfully. Sep 28 15:10:48 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a Sep 28 15:10:48 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:48 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a" returned: 0 in 0.510s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:48 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a Sep 28 15:10:48 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:48 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd0ba5c7-c397-4342-8e23-6bc9e191db4a" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-quobyte-bd0ba5c7-c397-4342-8e23-6bc9e191db4a" released by "delete_volume" :: held 0.922s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=95,cinder:UPDATE=127,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Created reservations ['46e522f9-99cb-433b-a538-b67743da6284', 'e6ac06c7-9605-4f31-9b6f-4ae9b73b46ae', 'a0703fa5-8a58-4400-8079-c8932fb6222f', '2a3444ab-e89d-4879-9a3f-c4a3ac2575ba'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:49 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:49 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "cinder-3e38860b-65a2-4395-ac1d-44d3860c6dc5-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-3e38860b-65a2-4395-ac1d-44d3860c6dc5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "cinder-quobyte-3e38860b-65a2-4395-ac1d-44d3860c6dc5" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-quobyte-3e38860b-65a2-4395-ac1d-44d3860c6dc5" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[76be0c2e-24f1-4aab-a291-0178df1cb3e6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:49 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.374s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Deleted volume successfully. Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5f71c512-71f8-49b2-bc36-c4e7b22bc904 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-bd0ba5c7-c397-4342-8e23-6bc9e191db4a-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:49 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 Sep 28 15:10:49 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (5bfc8b37-e54e-480e-b521-8881d0d08ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0045897-db72-4d86-8818-ddb824059eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0045897-db72-4d86-8818-ddb824059eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-652354012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26996747-60c6-49f2-b2d3-0c2dd9604036,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4c9412f1-f65e-44d2-98a6-14fc35908630,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:50Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd151b79-c5ad-4f60-9571-4dfba9f213f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd151b79-c5ad-4f60-9571-4dfba9f213f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a8f28d-5e95-40cb-93cb-d860e88c6101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5" returned: 0 in 0.584s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a8f28d-5e95-40cb-93cb-d860e88c6101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '26996747-60c6-49f2-b2d3-0c2dd9604036', 'volume_name': 'volume-26996747-60c6-49f2-b2d3-0c2dd9604036', 'volume_size': 1, 'source_volid': '4c9412f1-f65e-44d2-98a6-14fc35908630', 'source_volstatus': 'available'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6dbc49-96d6-4009-b890-d56eb20ce8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6dbc49-96d6-4009-b890-d56eb20ce8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5 Sep 28 15:10:49 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109ae595-7fe8-4148-a6a6-a69891b1005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Volume 26996747-60c6-49f2-b2d3-0c2dd9604036: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-26996747-60c6-49f2-b2d3-0c2dd9604036', 'volume_size': 1, 'source_volid': '4c9412f1-f65e-44d2-98a6-14fc35908630', 'source_volstatus': 'available'} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:49 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Cloning volume 4c9412f1-f65e-44d2-98a6-14fc35908630 to volume 26996747-60c6-49f2-b2d3-0c2dd9604036 Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Creating offline snapshot 7101d1d4-d4de-4126-912c-76a2b56a8455 of volume 4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[136fb312-43f7-4e56-b2be-749dc9a3bc38]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:50 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 Sep 28 15:10:50 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:50 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3e38860b-65a2-4395-ac1d-44d3860c6dc5" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-quobyte-3e38860b-65a2-4395-ac1d-44d3860c6dc5" released by "delete_volume" :: held 1.068s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Created reservations ['d1799312-8332-4bbc-a612-255a5338fb02', '49a437f7-0863-4008-96ef-bf83b7aa8d73', '46e76b5b-b924-438b-93c6-1423a5aafbc3', '1dc40283-0193-4477-9e3f-1301132a5e7c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:50 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:50 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:50 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630" returned: 0 in 0.582s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:50 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 1G Sep 28 15:10:50 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:50 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.312s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:50 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Deleted volume successfully. Sep 28 15:10:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0d4b11ab-9bde-41b7-b657-94d251652345 tempest-VolumesListTestJSON-282187040 None] Lock "cinder-3e38860b-65a2-4395-ac1d-44d3860c6dc5-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:50 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b7c54ebe-bbf9-4679-a11b-8f129513f8fa tempest-GroupsV320Test-697597759 None] Group tempest-GroupsV320Test-Group-1816740220: creating Sep 28 15:10:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b7c54ebe-bbf9-4679-a11b-8f129513f8fa tempest-GroupsV320Test-697597759 None] Group tempest-GroupsV320Test-Group-1816740220: created successfully Sep 28 15:10:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b7c54ebe-bbf9-4679-a11b-8f129513f8fa tempest-GroupsV320Test-697597759 None] Create group completed successfully. Sep 28 15:10:51 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 1G" returned: 0 in 0.592s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9412f1-f65e-44d2-98a6-14fc35908630 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:51 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9412f1-f65e-44d2-98a6-14fc35908630 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 Sep 28 15:10:51 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:51 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9412f1-f65e-44d2-98a6-14fc35908630 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455" returned: 0 in 0.416s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:51 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 is being set with open permissions: ugo+rw Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:51 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 Sep 28 15:10:51 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Flow 'volume_create_manager' (d5a8bb4e-1605-46fb-98ab-d11d6eaede2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c33b6a6-9b81-4715-ad4e-cd9516e14c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c33b6a6-9b81-4715-ad4e-cd9516e14c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-127963326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546244a6-eca7-4b76-a512-350a39b37c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c7a034d2a04676a8dc4a14f151b8a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:52Z,use_quota=True,user_id='b46d7474f664491e918f384a607ebb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf7b437-f3c6-43ac-b3db-dbbcd99b76e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf7b437-f3c6-43ac-b3db-dbbcd99b76e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d4b0ea-3d56-4830-af36-338cdcfff8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d4b0ea-3d56-4830-af36-338cdcfff8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546244a6-eca7-4b76-a512-350a39b37c38', 'volume_name': 'volume-546244a6-eca7-4b76-a512-350a39b37c38', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b226a85-954b-4060-b1a9-c6229d86cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b226a85-954b-4060-b1a9-c6229d86cfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f68f8c-8207-42c2-abb5-a6d8921ef40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:51 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Volume 546244a6-eca7-4b76-a512-350a39b37c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546244a6-eca7-4b76-a512-350a39b37c38', 'volume_size': 1} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:51 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455" returned: 0 in 0.346s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:51 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.info Sep 28 15:10:51 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:52 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.info" returned: 0 in 0.375s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:52 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.info is being set with open permissions: ugo+rw Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.info Sep 28 15:10:52 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:52 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.info" returned: 0 in 0.393s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-26996747-60c6-49f2-b2d3-0c2dd9604036" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-26996747-60c6-49f2-b2d3-0c2dd9604036" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] snapshot: 7101d1d4-d4de-4126-912c-76a2b56a8455, volume: 26996747-60c6-49f2-b2d3-0c2dd9604036, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Created reservations ['7226babc-a846-46f5-9312-21dada6a2946'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d595d390-3ba7-4075-a993-8db937d037c5]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:10:52 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 Sep 28 15:10:53 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.296s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:53 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6ac874f8-71cb-4371-99e7-d338d0731f12 tempest-GroupsV320Test-697597759 None] Delete group completed successfully. Sep 28 15:10:53 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455" returned: 0 in 0.480s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c9412f1-f65e-44d2-98a6-14fc35908630(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd82d490-a64b-45e0-8458-592c7842bfad]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:53 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 Sep 28 15:10:53 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630" returned: 0 in 0.519s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:10:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:53 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 Sep 28 15:10:53 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:02 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:02 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:INSERT=6,cinder:UPDATE=22,cinder:SELECT=22,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:03 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036" returned: 0 in 9.227s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630, size 1024.00 MB, duration 9.23 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:11:03 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Converted 1024.00 MB image at 110.96 MB/s Sep 28 15:11:03 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 is being set with open permissions: ugo+rw Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:03 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 Sep 28 15:11:03 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:03 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036" returned: 0 in 0.364s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-26996747-60c6-49f2-b2d3-0c2dd9604036" released by "_copy_volume_from_snapshot" :: held 10.701s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-7101d1d4-d4de-4126-912c-76a2b56a8455" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-7101d1d4-d4de-4126-912c-76a2b56a8455" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Deleting offline snapshot 7101d1d4-d4de-4126-912c-76a2b56a8455 of volume 4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] snapshot_file for this snap is: volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[82647b6c-d8ae-4b15-ab04-0b94634ec2a6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:03 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 Sep 28 15:11:03 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:04 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455" returned: 0 in 0.518s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c9412f1-f65e-44d2-98a6-14fc35908630(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:04 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b563e-c3ab-4400-ab69-31e736e95bb4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:04 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 Sep 28 15:11:04 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:04 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630" returned: 0 in 0.606s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:04 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 Sep 28 15:11:04 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:05 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:05 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455 Sep 28 15:11:05 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:05 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630.7101d1d4-d4de-4126-912c-76a2b56a8455" returned: 0 in 0.400s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-7101d1d4-d4de-4126-912c-76a2b56a8455" released by "_delete_snapshot" :: held 2.078s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.768s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.918s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-127963326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546244a6-eca7-4b76-a512-350a39b37c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c7a034d2a04676a8dc4a14f151b8a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:52Z,use_quota=True,user_id='b46d7474f664491e918f384a607ebb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Creating volume 546244a6-eca7-4b76-a512-350a39b37c38 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:05 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109ae595-7fe8-4148-a6a6-a69891b1005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26996747-60c6-49f2-b2d3-0c2dd9604036', 'volume_size': 1, 'source_volid': '4c9412f1-f65e-44d2-98a6-14fc35908630', 'source_volstatus': 'available'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26538c20-26bf-499a-b5ab-2e47c74d3bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 1073741824 Sep 28 15:11:05 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Volume volume-26996747-60c6-49f2-b2d3-0c2dd9604036 (26996747-60c6-49f2-b2d3-0c2dd9604036): created successfully Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26538c20-26bf-499a-b5ab-2e47c74d3bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (5bfc8b37-e54e-480e-b521-8881d0d08ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6d9c9cd4-cb23-45a6-8f61-920557205550 tempest-VolumesGetTest-1619699062 None] Created volume successfully. Sep 28 15:11:06 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 1073741824" returned: 0 in 0.634s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:06 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 Sep 28 15:11:06 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:06 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38" returned: 0 in 0.390s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f68f8c-8207-42c2-abb5-a6d8921ef40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546244a6-eca7-4b76-a512-350a39b37c38', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eadf25-4b2b-4c0c-acb3-e3bbbfa08fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Volume volume-546244a6-eca7-4b76-a512-350a39b37c38 (546244a6-eca7-4b76-a512-350a39b37c38): created successfully Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eadf25-4b2b-4c0c-acb3-e3bbbfa08fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Flow 'volume_create_manager' (d5a8bb4e-1605-46fb-98ab-d11d6eaede2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2baa0734-efe4-42af-9795-e6ecf7fba4c2 tempest-VolumesMetadataTest-1869428498 None] Created volume successfully. Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (7637cff1-ff96-4ed3-b2a1-eb4a96ad610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c6d7c8-ff84-4d64-be6a-26cdf799a5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c6d7c8-ff84-4d64-be6a-26cdf799a5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1964949873',display_name='tempest-VolumesGetTest-Volume-754107696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f079a2-3391-48c9-8a01-21213446d1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:07Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dee042f-a92a-4377-a751-25109ab4f5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dee042f-a92a-4377-a751-25109ab4f5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6061d5d1-85ce-42ad-b38c-ccfa6c1a0d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6061d5d1-85ce-42ad-b38c-ccfa6c1a0d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f079a2-3391-48c9-8a01-21213446d1a2', 'volume_name': 'volume-99f079a2-3391-48c9-8a01-21213446d1a2', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a662e8-1896-40c4-96c3-1cac255b7283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a662e8-1896-40c4-96c3-1cac255b7283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc612de-6f4e-4dd9-a02e-85d1ca9afb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:07 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Volume 99f079a2-3391-48c9-8a01-21213446d1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f079a2-3391-48c9-8a01-21213446d1a2', 'volume_size': 1} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1964949873',display_name='tempest-VolumesGetTest-Volume-754107696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f079a2-3391-48c9-8a01-21213446d1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:07Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Creating volume 99f079a2-3391-48c9-8a01-21213446d1a2 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:07 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:07 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 1073741824 Sep 28 15:11:07 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:08 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 1073741824" returned: 0 in 0.833s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:08 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 Sep 28 15:11:08 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:08 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2" returned: 0 in 0.414s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc612de-6f4e-4dd9-a02e-85d1ca9afb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f079a2-3391-48c9-8a01-21213446d1a2', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c755ddc9-92cf-4a41-97fa-c0cef24ac87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:09 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Volume volume-99f079a2-3391-48c9-8a01-21213446d1a2 (99f079a2-3391-48c9-8a01-21213446d1a2): created successfully Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c755ddc9-92cf-4a41-97fa-c0cef24ac87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (7637cff1-ff96-4ed3-b2a1-eb4a96ad610d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Acquiring lock "cinder-546244a6-eca7-4b76-a512-350a39b37c38-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-182b0ff8-c29d-4695-9c0a-4cd9221d3bd7 tempest-VolumesGetTest-1619699062 None] Created volume successfully. Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Lock "cinder-546244a6-eca7-4b76-a512-350a39b37c38-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Acquiring lock "cinder-quobyte-546244a6-eca7-4b76-a512-350a39b37c38" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Lock "cinder-quobyte-546244a6-eca7-4b76-a512-350a39b37c38" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9167e1-476d-4bae-b0d8-74e43d552411]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 Sep 28 15:11:09 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:09 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38" returned: 0 in 0.532s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38 Sep 28 15:11:09 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-99f079a2-3391-48c9-8a01-21213446d1a2-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Lock "cinder-99f079a2-3391-48c9-8a01-21213446d1a2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-99f079a2-3391-48c9-8a01-21213446d1a2" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-99f079a2-3391-48c9-8a01-21213446d1a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fe1318-de5c-4d40-a5f3-32c884c19030]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:10 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-546244a6-eca7-4b76-a512-350a39b37c38" returned: 0 in 0.413s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Lock "cinder-quobyte-546244a6-eca7-4b76-a512-350a39b37c38" released by "delete_volume" :: held 1.024s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Created reservations ['b0303134-6755-48f9-a909-be2ca2f0b983', 'd479c6a8-b405-4407-b94f-c9c41e73bb14', 'd85211c1-414d-47ed-bda0-219f2cd3b6b2', '4ddf6edb-b63f-4d8d-8c07-4f01cec2f82c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:10 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 Sep 28 15:11:10 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:10 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:10 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:10 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2" returned: 0 in 0.619s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:10 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2 Sep 28 15:11:10 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:10 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.355s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Deleted volume successfully. Sep 28 15:11:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3be9bd75-7ef7-4c76-9d11-c12c502c8142 tempest-VolumesMetadataTest-1869428498 None] Lock "cinder-546244a6-eca7-4b76-a512-350a39b37c38-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:11 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-99f079a2-3391-48c9-8a01-21213446d1a2" returned: 0 in 0.329s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-99f079a2-3391-48c9-8a01-21213446d1a2" released by "delete_volume" :: held 1.015s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Created reservations ['90eb5f3b-ac90-4967-b9b5-bb8b9dd618f2', 'e7368112-1c66-41d4-9093-a7f92b943341', 'bdc63016-e2e8-47ad-8e07-49d99fc82ab4', '8340418f-28ff-4616-a527-284cbed45e5b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:11 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:11 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:11 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Deleted volume successfully. Sep 28 15:11:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5104e287-46bd-4163-bc5d-a9d12229cc9a tempest-VolumesGetTest-1619699062 None] Lock "cinder-99f079a2-3391-48c9-8a01-21213446d1a2-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-26996747-60c6-49f2-b2d3-0c2dd9604036-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Lock "cinder-26996747-60c6-49f2-b2d3-0c2dd9604036-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-26996747-60c6-49f2-b2d3-0c2dd9604036" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-26996747-60c6-49f2-b2d3-0c2dd9604036" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b0da3-26a1-4e6b-98bc-e28af67d9bd4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:12 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 Sep 28 15:11:12 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:13 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036" returned: 0 in 0.618s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:13 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036 Sep 28 15:11:13 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:13 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26996747-60c6-49f2-b2d3-0c2dd9604036" returned: 0 in 0.471s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-26996747-60c6-49f2-b2d3-0c2dd9604036" released by "delete_volume" :: held 1.171s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Created reservations ['d3110828-1788-44eb-aa13-03b6270b083d', '94f59947-5d5d-4532-ae31-a6cd129b822f', 'ec4e4fe1-b5c8-47c6-af68-6573491a5601', '238ffc2b-370e-4dc1-9337-2406e174ab29'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:14 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:14 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:14 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.356s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Deleted volume successfully. Sep 28 15:11:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7a1e879c-2906-4802-b4df-f597fd594317 tempest-VolumesGetTest-1619699062 None] Lock "cinder-26996747-60c6-49f2-b2d3-0c2dd9604036-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-4c9412f1-f65e-44d2-98a6-14fc35908630-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Lock "cinder-4c9412f1-f65e-44d2-98a6-14fc35908630-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-4c9412f1-f65e-44d2-98a6-14fc35908630" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-4c9412f1-f65e-44d2-98a6-14fc35908630" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[795644b3-1401-4588-a98c-621e10338034]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:15 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 Sep 28 15:11:15 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:16 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630" returned: 0 in 0.632s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:16 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630 Sep 28 15:11:16 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:16 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c9412f1-f65e-44d2-98a6-14fc35908630" returned: 0 in 0.342s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-4c9412f1-f65e-44d2-98a6-14fc35908630" released by "delete_volume" :: held 1.115s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Created reservations ['19322d9c-062c-4ff5-b7bf-060086a0107b', 'f3c75bb9-f9c6-48e5-9915-8e4e80da7de2', '780ad48a-a7f2-4a9a-a52f-f3f2a838f925', '1ea9e18a-8d13-48ee-a9c2-71881d35f379'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:16 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:16 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:17 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.332s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Deleted volume successfully. Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Flow 'volume_create_manager' (03d9053b-eb5a-467e-9e6b-ca76a41969f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca3fe9f-4c7a-4677-a7b5-d85cef6d04df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca3fe9f-4c7a-4677-a7b5-d85cef6d04df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1657465419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcee155e-b5a3-47cf-9da1-6c23edb59890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de0ca824c64b0cba0d2d7551d16b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:17Z,use_quota=True,user_id='8c553fd1e3864d0cae83ab8cc0cf6084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b93ffeb-3a08-4159-ba06-38e48b21b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b93ffeb-3a08-4159-ba06-38e48b21b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cbaa77-6061-4a53-9844-88e9e2a73e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cbaa77-6061-4a53-9844-88e9e2a73e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcee155e-b5a3-47cf-9da1-6c23edb59890', 'volume_name': 'volume-fcee155e-b5a3-47cf-9da1-6c23edb59890', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb4f7b1-4850-4780-a996-234374b4e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb4f7b1-4850-4780-a996-234374b4e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db0b908-4d2d-44e9-9c11-fede977e6372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:17 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Volume fcee155e-b5a3-47cf-9da1-6c23edb59890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcee155e-b5a3-47cf-9da1-6c23edb59890', 'volume_size': 1} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1657465419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcee155e-b5a3-47cf-9da1-6c23edb59890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de0ca824c64b0cba0d2d7551d16b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:17Z,use_quota=True,user_id='8c553fd1e3864d0cae83ab8cc0cf6084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Creating volume fcee155e-b5a3-47cf-9da1-6c23edb59890 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:17 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bf7699a0-896c-4828-aebf-0a9f59c536ba tempest-VolumesGetTest-1619699062 None] Lock "cinder-4c9412f1-f65e-44d2-98a6-14fc35908630-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:17 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 1073741824 Sep 28 15:11:17 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:17 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 1073741824" returned: 0 in 0.695s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:18 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 Sep 28 15:11:18 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:18 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890" returned: 0 in 0.398s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db0b908-4d2d-44e9-9c11-fede977e6372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcee155e-b5a3-47cf-9da1-6c23edb59890', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4961f60f-dcf6-4448-915d-1f558c820019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:18 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Volume volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 (fcee155e-b5a3-47cf-9da1-6c23edb59890): created successfully Sep 28 15:11:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4961f60f-dcf6-4448-915d-1f558c820019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Flow 'volume_create_manager' (03d9053b-eb5a-467e-9e6b-ca76a41969f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b9008a1a-bcc4-453e-a71a-cda918ad4dc9 tempest-VolumeQuotasAdminTestJSON-294830075 None] Created volume successfully. Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (1cba0e07-dbe7-4e94-b3cf-30a2fed38c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c51d20b-ae40-44a9-9374-d319d71f4abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c51d20b-ae40-44a9-9374-d319d71f4abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-157710989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3b4ea7-3c20-4d69-8bca-a75a3a608eab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:19Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfceb91-89a8-4c6f-804a-d540d5ddb014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfceb91-89a8-4c6f-804a-d540d5ddb014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aef73bf-a829-4a8c-9229-8f940f721cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Acquiring lock "cinder-fcee155e-b5a3-47cf-9da1-6c23edb59890-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "cinder-fcee155e-b5a3-47cf-9da1-6c23edb59890-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Acquiring lock "cinder-quobyte-fcee155e-b5a3-47cf-9da1-6c23edb59890" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "cinder-quobyte-fcee155e-b5a3-47cf-9da1-6c23edb59890" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e683ba3f-e118-4bf6-a05f-1dd215f20740]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 Sep 28 15:11:20 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aef73bf-a829-4a8c-9229-8f940f721cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e3b4ea7-3c20-4d69-8bca-a75a3a608eab', 'volume_name': 'volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561c03ac-f936-497c-adc4-534f69c40bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561c03ac-f936-497c-adc4-534f69c40bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b74241d-2aed-4c01-895d-76b6a9c6184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Volume 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Trying to clone 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd at location (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:11:20 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890" returned: 0 in 0.489s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890 Sep 28 15:11:20 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Flow 'volume_create_manager' (f5e12dec-746f-47cd-bb07-854e33ae44e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dd8415-f5d5-435d-a65e-20061e1e847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dd8415-f5d5-435d-a65e-20061e1e847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-455413746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c0188c-8b6f-4239-9724-3cf4fd5e075c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67b2409570b41cc8f9c90c40bb2f58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:20Z,use_quota=True,user_id='10a04a05bd19449cba5535e58aa528e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb25e99-3cd6-4f74-9623-60fe07c6ae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb25e99-3cd6-4f74-9623-60fe07c6ae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e65fd-b8df-41de-8292-b99f3934afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e65fd-b8df-41de-8292-b99f3934afa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c0188c-8b6f-4239-9724-3cf4fd5e075c', 'volume_name': 'volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350056df-89c6-43dd-b0d2-ed8364fc0d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350056df-89c6-43dd-b0d2-ed8364fc0d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1987f3a9-b8dd-4e79-a603-d49cabd72522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Volume 75c0188c-8b6f-4239-9724-3cf4fd5e075c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c', 'volume_size': 1} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-455413746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c0188c-8b6f-4239-9724-3cf4fd5e075c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67b2409570b41cc8f9c90c40bb2f58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:20Z,use_quota=True,user_id='10a04a05bd19449cba5535e58aa528e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Creating volume 75c0188c-8b6f-4239-9724-3cf4fd5e075c {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:20 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:20 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c 1073741824 Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcee155e-b5a3-47cf-9da1-6c23edb59890" returned: 0 in 0.372s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:20 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "cinder-quobyte-fcee155e-b5a3-47cf-9da1-6c23edb59890" released by "delete_volume" :: held 0.954s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:11:20 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Created reservations ['ca83daba-c02f-4473-ada0-5df67b2460f8', 'a05849ea-b71f-44be-9e81-da3dccd9c0f4', 'df02f440-00fa-4904-bdd7-ca9cd0fc51a1', '3efe5fad-c504-488f-b489-c2beb7b93f7a'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e626e48-6d7d-4846-a726-72043f590e9f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:21 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:21 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD Sep 28 15:11:21 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd is fetched for user 4996e6664785491b8b3ed1eda21499ba. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:11:21 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c 1073741824" returned: 0 in 0.823s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:21 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[06117586-b674-46a4-97ae-737a23f92347]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.599s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:21 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c Sep 28 15:11:21 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Deleted volume successfully. Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f009fb8c-7f97-4481-ba91-f8213de9f65a tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "cinder-fcee155e-b5a3-47cf-9da1-6c23edb59890-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:21 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD Sep 28 15:11:21 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c" returned: 0 in 0.407s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1987f3a9-b8dd-4e79-a603-d49cabd72522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32c3309-ef96-4b0d-9626-1ed0b9b16d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:22 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Volume volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c (75c0188c-8b6f-4239-9724-3cf4fd5e075c): created successfully Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32c3309-ef96-4b0d-9626-1ed0b9b16d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Flow 'volume_create_manager' (f5e12dec-746f-47cd-bb07-854e33ae44e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:22 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4d06314d-3ed6-4381-9bf5-25696b5046a6 tempest-VolumesTransfersV355Test-1728270828 None] Created volume successfully. Sep 28 15:11:22 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD" returned: 0 in 0.526s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-157710989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3b4ea7-3c20-4d69-8bca-a75a3a608eab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:19Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Creating volume 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:22 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab 1073741824 Sep 28 15:11:22 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:22 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Flow 'volume_create_manager' (b9c080c6-7d0d-4cce-b24e-aa7fe64067d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd3b6c4-08ec-4661-a10f-e415390e9ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab 1073741824" returned: 0 in 0.762s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd3b6c4-08ec-4661-a10f-e415390e9ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1178421976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b159ce-4079-4752-89cf-bd81c274cdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de0ca824c64b0cba0d2d7551d16b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:23Z,use_quota=True,user_id='8c553fd1e3864d0cae83ab8cc0cf6084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8655b209-d96f-4903-8d47-35a397c76599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8655b209-d96f-4903-8d47-35a397c76599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2594d88-64c8-4e17-b771-7db5c7a0014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2594d88-64c8-4e17-b771-7db5c7a0014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b159ce-4079-4752-89cf-bd81c274cdaa', 'volume_name': 'volume-80b159ce-4079-4752-89cf-bd81c274cdaa', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1b8eab-09f4-4454-8b02-a6f00b883442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1b8eab-09f4-4454-8b02-a6f00b883442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e28338-889c-4c26-af2e-74c2608d1146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:22 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Volume 80b159ce-4079-4752-89cf-bd81c274cdaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b159ce-4079-4752-89cf-bd81c274cdaa', 'volume_size': 1} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab Sep 28 15:11:23 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab" returned: 0 in 0.343s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1178421976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b159ce-4079-4752-89cf-bd81c274cdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84de0ca824c64b0cba0d2d7551d16b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:23Z,use_quota=True,user_id='8c553fd1e3864d0cae83ab8cc0cf6084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Creating volume 80b159ce-4079-4752-89cf-bd81c274cdaa {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:23 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa 1073741824 Sep 28 15:11:23 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Attempting download of 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6338491-5142-47a5-81f8-19aac3171257]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_j5rgpi7o {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_j5rgpi7o Sep 28 15:11:23 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8d68f501-7a14-4ee7-9685-91c1aa735758 tempest-VolumesTransfersV355Test-1978045732 None] Transfer volume completed successfully. Sep 28 15:11:24 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_j5rgpi7o" returned: 0 in 0.529s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_j5rgpi7o {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa 1073741824" returned: 0 in 0.749s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa Sep 28 15:11:24 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:24 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_j5rgpi7o Sep 28 15:11:24 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:24 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa" returned: 0 in 0.315s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e28338-889c-4c26-af2e-74c2608d1146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b159ce-4079-4752-89cf-bd81c274cdaa', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a81ba0a-edc6-483a-a8cb-30b5ba743a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Volume volume-80b159ce-4079-4752-89cf-bd81c274cdaa (80b159ce-4079-4752-89cf-bd81c274cdaa): created successfully Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a81ba0a-edc6-483a-a8cb-30b5ba743a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Flow 'volume_create_manager' (b9c080c6-7d0d-4cce-b24e-aa7fe64067d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-78f7080c-388e-454b-83ea-b5b75949fe9f tempest-VolumeQuotasAdminTestJSON-294830075 None] Created volume successfully. Sep 28 15:11:24 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_j5rgpi7o" returned: 1 in 0.565s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_j5rgpi7o' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e1e5bf-5757-41cc-8e68-d3ad348ece27]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD Sep 28 15:11:24 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Acquiring lock "cinder-75c0188c-8b6f-4239-9724-3cf4fd5e075c-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-75c0188c-8b6f-4239-9724-3cf4fd5e075c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Acquiring lock "cinder-quobyte-75c0188c-8b6f-4239-9724-3cf4fd5e075c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-quobyte-75c0188c-8b6f-4239-9724-3cf4fd5e075c" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81c5b29-7ae1-44f9-8de6-cd8fb3bb3d60]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd was qcow2, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab Sep 28 15:11:25 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c Sep 28 15:11:25 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c" returned: 0 in 0.509s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c Sep 28 15:11:25 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75c0188c-8b6f-4239-9724-3cf4fd5e075c" returned: 0 in 0.345s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-quobyte-75c0188c-8b6f-4239-9724-3cf4fd5e075c" released by "delete_volume" :: held 0.920s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5cc1a3f5-74de-49dd-b2ad-425494e49ee0 tempest-VolumeQuotasAdminTestJSON-767282630 None] Transfer volume completed successfully. Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Created reservations ['75e56037-5b6f-4907-af59-c0fe3c955ac6', '10d3b447-fade-4a3a-bbc1-20c4cc627eda', 'f68d4d3d-6e69-4e11-9527-c91116e945b6', '15da9ac0-2533-4af3-9306-47aa25181151'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:26 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:26 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.439s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:26 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Deleted volume successfully. Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2e35ca95-f284-49c8-957e-7721b04d5e57 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-75c0188c-8b6f-4239-9724-3cf4fd5e075c-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Acquiring lock "cinder-80b159ce-4079-4752-89cf-bd81c274cdaa-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Lock "cinder-80b159ce-4079-4752-89cf-bd81c274cdaa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Acquiring lock "cinder-quobyte-80b159ce-4079-4752-89cf-bd81c274cdaa" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Lock "cinder-quobyte-80b159ce-4079-4752-89cf-bd81c274cdaa" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b64396e-6349-4483-9cf1-4833d76a49ee]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:27 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa Sep 28 15:11:27 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:27 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa" returned: 0 in 0.455s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:27 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa Sep 28 15:11:27 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:27 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80b159ce-4079-4752-89cf-bd81c274cdaa" returned: 0 in 0.387s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Lock "cinder-quobyte-80b159ce-4079-4752-89cf-bd81c274cdaa" released by "delete_volume" :: held 0.923s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:27 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Created reservations ['01b28870-fbdb-430e-ba2d-1439aede767c', '2a4a4859-ed8a-4eef-a25a-6f6ad6d40dc6', '457db6d2-f770-4910-a355-8534b0184a17', '3a0fa8df-a149-45e0-b3a0-7801dcad438c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:28 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:28 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:28 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Flow 'volume_create_manager' (a65a0096-b905-4e0e-a7bc-d8c07bf9f973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9551330e-f172-490a-8923-2d2575828799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab" returned: 0 in 3.130s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_c7ylv086devstack@QuobyteHD, size 112.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:11:28 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Converted 112.00 MB image at 35.76 MB/s Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9551330e-f172-490a-8923-2d2575828799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-451326811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b87476e-600b-413d-804c-56e52723ef65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67b2409570b41cc8f9c90c40bb2f58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:28Z,use_quota=True,user_id='10a04a05bd19449cba5535e58aa528e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70737619-8d75-404c-adfb-5b456e9eb47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70737619-8d75-404c-adfb-5b456e9eb47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab 1G Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46db56-a073-4329-9dc5-39d72b90a09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46db56-a073-4329-9dc5-39d72b90a09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b87476e-600b-413d-804c-56e52723ef65', 'volume_name': 'volume-1b87476e-600b-413d-804c-56e52723ef65', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1b83e-e81c-4cf5-abef-82a158959821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1b83e-e81c-4cf5-abef-82a158959821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e542dd-f0f2-474d-8687-9a1fdd7e2631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:28 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Volume 1b87476e-600b-413d-804c-56e52723ef65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b87476e-600b-413d-804c-56e52723ef65', 'volume_size': 1} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-451326811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b87476e-600b-413d-804c-56e52723ef65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67b2409570b41cc8f9c90c40bb2f58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:28Z,use_quota=True,user_id='10a04a05bd19449cba5535e58aa528e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Creating volume 1b87476e-600b-413d-804c-56e52723ef65 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:28 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 1073741824 Sep 28 15:11:28 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.571s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:28 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Deleted volume successfully. Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8e310234-04e7-4f18-a3af-bb24872bb955 tempest-VolumeQuotasAdminTestJSON-1467008422 None] Lock "cinder-80b159ce-4079-4752-89cf-bd81c274cdaa-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:28 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab 1G" returned: 0 in 0.668s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Downloaded image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd for user 4996e6664785491b8b3ed1eda21499ba is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Marking volume 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Copying metadata from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd to 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:11:28 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Creating volume glance metadata for volume 1e3b4ea7-3c20-4d69-8bca-a75a3a608eab backed by image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b74241d-2aed-4c01-895d-76b6a9c6184d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeffdcc3-84fb-49b1-ac6d-aaecd98962d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:29 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Volume volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab (1e3b4ea7-3c20-4d69-8bca-a75a3a608eab): created successfully Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeffdcc3-84fb-49b1-ac6d-aaecd98962d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (1cba0e07-dbe7-4e94-b3cf-30a2fed38c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d977d5c5-eb1e-4c07-9b13-25a3f4314072 tempest-VolumesGetTest-1619699062 None] Created volume successfully. Sep 28 15:11:29 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 1073741824" returned: 0 in 0.866s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:29 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 Sep 28 15:11:29 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:29 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65" returned: 0 in 0.462s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e542dd-f0f2-474d-8687-9a1fdd7e2631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b87476e-600b-413d-804c-56e52723ef65', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086ce9e-76af-4db5-909c-ebb761f3ee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:29 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Volume volume-1b87476e-600b-413d-804c-56e52723ef65 (1b87476e-600b-413d-804c-56e52723ef65): created successfully Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086ce9e-76af-4db5-909c-ebb761f3ee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Flow 'volume_create_manager' (a65a0096-b905-4e0e-a7bc-d8c07bf9f973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d72fd317-3b36-4392-adc7-c1ac0b321f5a tempest-VolumesTransfersV355Test-1728270828 None] Created volume successfully. Sep 28 15:11:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Acquiring lock "cinder-1b87476e-600b-413d-804c-56e52723ef65-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-1b87476e-600b-413d-804c-56e52723ef65-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Acquiring lock "cinder-quobyte-1b87476e-600b-413d-804c-56e52723ef65" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-quobyte-1b87476e-600b-413d-804c-56e52723ef65" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d69ce70-28d3-41b3-b2f8-d76653e3b5d8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:31 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 Sep 28 15:11:31 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (c90c2f0d-8b5e-407c-961c-ffcff8824cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79395c9b-f630-428c-a332-57fa88dd5643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79395c9b-f630-428c-a332-57fa88dd5643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1424693646',display_name='tempest-VolumesGetTest-Volume-908070437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0ce10c-3beb-4b58-904f-1d40a70b9776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:31Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632e0eb6-2f54-46ce-b0e3-67eca1e930af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632e0eb6-2f54-46ce-b0e3-67eca1e930af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd80774-5aac-4971-ba5f-f4702f361717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd80774-5aac-4971-ba5f-f4702f361717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec0ce10c-3beb-4b58-904f-1d40a70b9776', 'volume_name': 'volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c0dde0-dd8e-476a-92f3-a5e2d7a1cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c0dde0-dd8e-476a-92f3-a5e2d7a1cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e6feb1-78fb-4101-a96c-fef3cb674634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Volume ec0ce10c-3beb-4b58-904f-1d40a70b9776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776', 'volume_size': 1} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1424693646',display_name='tempest-VolumesGetTest-Volume-908070437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0ce10c-3beb-4b58-904f-1d40a70b9776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4fe8edddde4f8c8ce1dee3ab8e49ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:31Z,use_quota=True,user_id='4996e6664785491b8b3ed1eda21499ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Creating volume ec0ce10c-3beb-4b58-904f-1d40a70b9776 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:31 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65" returned: 0 in 0.648s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:31 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65 Sep 28 15:11:31 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:31 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 1073741824 Sep 28 15:11:31 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:32 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1b87476e-600b-413d-804c-56e52723ef65" returned: 0 in 0.429s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-quobyte-1b87476e-600b-413d-804c-56e52723ef65" released by "delete_volume" :: held 1.182s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Created reservations ['a7d466e1-4978-4419-8e68-8a348a152c41', 'b97ba76c-525a-4573-a935-5abc79134974', 'a05e96e8-df4b-4fe2-9cc6-f63e930c87a1', '772299b3-7c15-48a6-b6ac-50e2ad1ba730'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:32 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:32 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:32 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 1073741824" returned: 0 in 0.899s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:32 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 Sep 28 15:11:32 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:32 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.448s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:32 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Deleted volume successfully. Sep 28 15:11:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c5e7f9a-14d0-44f6-9566-29674dc3afc7 tempest-VolumesTransfersV355Test-988623058 None] Lock "cinder-1b87476e-600b-413d-804c-56e52723ef65-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:33 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776" returned: 0 in 0.499s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e6feb1-78fb-4101-a96c-fef3cb674634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b08038-0fa8-42e1-bdb8-f86bfc8c9432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Volume volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 (ec0ce10c-3beb-4b58-904f-1d40a70b9776): created successfully Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b08038-0fa8-42e1-bdb8-f86bfc8c9432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Flow 'volume_create_manager' (c90c2f0d-8b5e-407c-961c-ffcff8824cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:33 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-555452c0-4e97-45f1-8544-4c242f4e1be3 tempest-VolumesGetTest-1619699062 None] Created volume successfully. Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Flow 'volume_create_manager' (95ea2990-5f49-4b5a-958d-b466491b011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fa1725-aeeb-4c7f-a639-c3314b40411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fa1725-aeeb-4c7f-a639-c3314b40411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1751033326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6328cf-31c6-464c-bef5-5d230966a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078496bbc1dd4c9aa6b40a87423ce647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:33Z,use_quota=True,user_id='0b1a120c101d48e5a99f555beae04263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267dfb7f-14cb-43b9-b608-b63defc82176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267dfb7f-14cb-43b9-b608-b63defc82176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80d9349-a16e-4bdb-b8b4-12c47a27be9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80d9349-a16e-4bdb-b8b4-12c47a27be9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6328cf-31c6-464c-bef5-5d230966a4af', 'volume_name': 'volume-ad6328cf-31c6-464c-bef5-5d230966a4af', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f111e96-b050-491c-b9d3-965a3b604a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f111e96-b050-491c-b9d3-965a3b604a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33c5ccc-af6a-4e66-ab0d-859ed0257441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Volume ad6328cf-31c6-464c-bef5-5d230966a4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6328cf-31c6-464c-bef5-5d230966a4af', 'volume_size': 1} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1751033326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6328cf-31c6-464c-bef5-5d230966a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078496bbc1dd4c9aa6b40a87423ce647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:33Z,use_quota=True,user_id='0b1a120c101d48e5a99f555beae04263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Creating volume ad6328cf-31c6-464c-bef5-5d230966a4af {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:33 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:33 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af 1073741824 Sep 28 15:11:33 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:33 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:33 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-ec0ce10c-3beb-4b58-904f-1d40a70b9776-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:33 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Lock "cinder-ec0ce10c-3beb-4b58-904f-1d40a70b9776-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-ec0ce10c-3beb-4b58-904f-1d40a70b9776" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-ec0ce10c-3beb-4b58-904f-1d40a70b9776" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b7308-29ee-4580-b1a3-a6a9fb8760b6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 Sep 28 15:11:34 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.649s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Flow 'volume_create_manager' (89b9012d-1f67-4fd5-9d36-2ccc9637def3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ce5640-96e9-4dd2-bd73-c4fdb569ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:34 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ce5640-96e9-4dd2-bd73-c4fdb569ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1641062559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389f3762-c178-4db8-9eab-a2f125c5a775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078496bbc1dd4c9aa6b40a87423ce647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:34Z,use_quota=True,user_id='0b1a120c101d48e5a99f555beae04263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1804c50-6fb9-4618-bc64-3519f13c7c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1804c50-6fb9-4618-bc64-3519f13c7c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8744f7-fffe-4a7a-952f-0baae15c557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8744f7-fffe-4a7a-952f-0baae15c557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '389f3762-c178-4db8-9eab-a2f125c5a775', 'volume_name': 'volume-389f3762-c178-4db8-9eab-a2f125c5a775', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abca40a7-a19e-4bcd-8582-4061cef1c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abca40a7-a19e-4bcd-8582-4061cef1c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2853cd-1b22-4d90-8509-14cd9add0e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:34 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Volume 389f3762-c178-4db8-9eab-a2f125c5a775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-389f3762-c178-4db8-9eab-a2f125c5a775', 'volume_size': 1} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af 1073741824" returned: 0 in 1.043s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af Sep 28 15:11:34 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776" returned: 0 in 0.754s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776 Sep 28 15:11:34 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:35 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af" returned: 0 in 0.510s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1641062559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389f3762-c178-4db8-9eab-a2f125c5a775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078496bbc1dd4c9aa6b40a87423ce647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:34Z,use_quota=True,user_id='0b1a120c101d48e5a99f555beae04263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Creating volume 389f3762-c178-4db8-9eab-a2f125c5a775 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:35 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:35 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 1073741824 Sep 28 15:11:35 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33c5ccc-af6a-4e66-ab0d-859ed0257441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6328cf-31c6-464c-bef5-5d230966a4af', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f16a17-0dc3-4c1b-acd8-9c70ad704d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Volume volume-ad6328cf-31c6-464c-bef5-5d230966a4af (ad6328cf-31c6-464c-bef5-5d230966a4af): created successfully Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f16a17-0dc3-4c1b-acd8-9c70ad704d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:35 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Flow 'volume_create_manager' (95ea2990-5f49-4b5a-958d-b466491b011e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ec0ce10c-3beb-4b58-904f-1d40a70b9776" returned: 0 in 0.546s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-ec0ce10c-3beb-4b58-904f-1d40a70b9776" released by "delete_volume" :: held 1.450s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-af1c77a5-f703-49fd-b05e-07fb76d920f8 tempest-TestServerVolumeAttachmentScenario-609627885 None] Created volume successfully. Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Created reservations ['0918d44a-9e7d-4c5f-b371-134ee1751fe7', '06de2c2d-31ff-460d-9fb6-00ad525836b6', 'd9e3e40d-70ca-4c90-9d30-6c4bad8e7dca', '03efa7b8-cf23-42ee-aba5-a9e5b384ebb0'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:35 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:35 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:36 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 1073741824" returned: 0 in 0.885s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:36 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 Sep 28 15:11:36 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:36 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Deleted volume successfully. Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f4d80b67-35ec-417a-a9b9-ff9cab5eb6ca tempest-VolumesGetTest-1619699062 None] Lock "cinder-ec0ce10c-3beb-4b58-904f-1d40a70b9776-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:36 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775" returned: 0 in 0.488s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2853cd-1b22-4d90-8509-14cd9add0e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389f3762-c178-4db8-9eab-a2f125c5a775', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b838da33-eb7e-411d-8299-e05327f30aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:36 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Volume volume-389f3762-c178-4db8-9eab-a2f125c5a775 (389f3762-c178-4db8-9eab-a2f125c5a775): created successfully Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b838da33-eb7e-411d-8299-e05327f30aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Flow 'volume_create_manager' (89b9012d-1f67-4fd5-9d36-2ccc9637def3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Lock "cinder-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a0745836-a986-4d62-bcd3-ce8c0ee6934c tempest-TestServerVolumeAttachmentScenario-609627885 None] Created volume successfully. Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Acquiring lock "cinder-quobyte-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e69c4-02ba-4489-abee-f279a0a8f559]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:37 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab Sep 28 15:11:37 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:37 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab" returned: 0 in 0.539s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:37 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab Sep 28 15:11:37 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:37 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab" returned: 0 in 0.357s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Lock "cinder-quobyte-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab" released by "delete_volume" :: held 0.953s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:37 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Created reservations ['6965689f-dfb0-4a3d-bc5e-a593b5bba972', 'e6589712-f45f-4f53-a372-1ad665a42d90', '568e64ed-5240-41b0-9a5b-0e109f5b7e0d', '96570414-fc42-4051-a01b-c083b3ea2a10'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:38 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:11:38 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:38 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.384s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:38 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Deleted volume successfully. Sep 28 15:11:38 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c6eee107-eeaf-4217-8d18-4aea4a78969a tempest-VolumesGetTest-1619699062 None] Lock "cinder-1e3b4ea7-3c20-4d69-8bca-a75a3a608eab-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Flow 'volume_create_manager' (cd217cfe-e45e-48c5-98eb-42c26c2a4efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1513d468-dfff-43d3-b791-190b0c4c1ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1513d468-dfff-43d3-b791-190b0c4c1ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1220494193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b39b4a789d4912ba056c9d1d39fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:47Z,use_quota=True,user_id='b5bd4223b111466ea9ab66976785df1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e3ae7b-6207-4966-bf43-8834f0d2d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e3ae7b-6207-4966-bf43-8834f0d2d282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871658eb-187d-4e25-87b3-f3311e9296eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871658eb-187d-4e25-87b3-f3311e9296eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1', 'volume_name': 'volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d27235f-6924-4f5e-ab54-ae069c8866c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d27235f-6924-4f5e-ab54-ae069c8866c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b7f40-49e8-4296-81d1-8813f239f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:47 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Volume 058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1', 'volume_size': 1} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1220494193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b39b4a789d4912ba056c9d1d39fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:47Z,use_quota=True,user_id='b5bd4223b111466ea9ab66976785df1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Creating volume 058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:47 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:47 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 1073741824 Sep 28 15:11:47 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 1073741824" returned: 0 in 0.849s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:48 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:48 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 Sep 28 15:11:48 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:49 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1" returned: 0 in 0.744s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b7f40-49e8-4296-81d1-8813f239f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e31b3d4-b6b7-4389-9f6d-3009d7751738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:49 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Volume volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 (058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1): created successfully Sep 28 15:11:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e31b3d4-b6b7-4389-9f6d-3009d7751738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Flow 'volume_create_manager' (cd217cfe-e45e-48c5-98eb-42c26c2a4efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5788bbaf-decb-4825-8f1f-7ed3df616c4d tempest-VolumesNegativeTest-1531426662 None] Created volume successfully. Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Flow 'volume_create_manager' (d2c89f06-7613-4a0e-bed1-2cf23aa1c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141709cc-c722-4c68-9eda-20b772207b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141709cc-c722-4c68-9eda-20b772207b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475716799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ee5a3c-edb5-4695-b5fb-b684cca9c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af355173589d4d8597669068517a4b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:52Z,use_quota=True,user_id='c61d712dae064fac9469fb6e9e6d01fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbbcac2-b296-409e-a6cc-e235eb3de7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbbcac2-b296-409e-a6cc-e235eb3de7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0ea8cb-7d16-447f-a586-f350bd634fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0ea8cb-7d16-447f-a586-f350bd634fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ee5a3c-edb5-4695-b5fb-b684cca9c423', 'volume_name': 'volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d97084-ef49-4c55-aa39-cdd6b38d8084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d97084-ef49-4c55-aa39-cdd6b38d8084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cae8824-42e3-4ce3-80e0-3be4c9659de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:51 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Volume 70ee5a3c-edb5-4695-b5fb-b684cca9c423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423', 'volume_size': 1} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475716799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ee5a3c-edb5-4695-b5fb-b684cca9c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af355173589d4d8597669068517a4b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:52Z,use_quota=True,user_id='c61d712dae064fac9469fb6e9e6d01fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Creating volume 70ee5a3c-edb5-4695-b5fb-b684cca9c423 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:51 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:11:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:51 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 1073741824 Sep 28 15:11:51 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:52 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 1073741824" returned: 0 in 1.021s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:52 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 Sep 28 15:11:52 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:53 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423" returned: 0 in 0.707s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cae8824-42e3-4ce3-80e0-3be4c9659de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5d8e46-1b9b-432d-86e1-bb9e91ea65f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:53 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Volume volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 (70ee5a3c-edb5-4695-b5fb-b684cca9c423): created successfully Sep 28 15:11:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5d8e46-1b9b-432d-86e1-bb9e91ea65f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:53 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Flow 'volume_create_manager' (d2c89f06-7613-4a0e-bed1-2cf23aa1c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:53 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-415dec8b-7292-488a-a3fa-0a359c0600f2 tempest-VolumesTransfersV357Test-1692126886 None] Created volume successfully. Sep 28 15:11:57 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b3191ebe-c08a-483e-806e-cc0e9ec4554a tempest-VolumesTransfersV357Test-480635864 None] Transfer volume completed successfully. Sep 28 15:11:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Acquiring lock "cinder-70ee5a3c-edb5-4695-b5fb-b684cca9c423-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-70ee5a3c-edb5-4695-b5fb-b684cca9c423-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Acquiring lock "cinder-quobyte-70ee5a3c-edb5-4695-b5fb-b684cca9c423" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-quobyte-70ee5a3c-edb5-4695-b5fb-b684cca9c423" acquired by "delete_volume" :: waited 0.037s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3da5cb-4397-497b-987c-b47795b47277]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:58 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 Sep 28 15:11:58 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:59 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423" returned: 0 in 0.591s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:59 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423 Sep 28 15:11:59 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:59 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-70ee5a3c-edb5-4695-b5fb-b684cca9c423" returned: 0 in 0.580s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-quobyte-70ee5a3c-edb5-4695-b5fb-b684cca9c423" released by "delete_volume" :: held 1.256s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:59 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Created reservations ['19b472f6-4128-4054-9719-cc9e8c04fb23', 'd2c8dfb8-f92c-4eb0-ab80-21e345057665', '7a08b15a-6a36-441b-ad56-7277792248ca', '5607274b-90db-45e7-b8bb-ced63a4a3ca7'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:00 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:00 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Flow 'volume_create_manager' (2e60729b-fd76-439f-8624-7803f3f8f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3eb384-077c-447a-bd75-95f49daf8faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.701s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3eb384-077c-447a-bd75-95f49daf8faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2075940892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bc1cf2-91cd-4aac-944b-f29b24fa64c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9255f901354d488bb77fd1022ac9c1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:01Z,use_quota=True,user_id='f753484d5b5046a99609e62ea4ddc694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5d37be-260f-47e6-8181-657bf3a9d2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5d37be-260f-47e6-8181-657bf3a9d2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df91ac1a-385e-463e-b2c9-47bb54e4b846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df91ac1a-385e-463e-b2c9-47bb54e4b846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bc1cf2-91cd-4aac-944b-f29b24fa64c9', 'volume_name': 'volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9d04a8-5570-4ee3-a51a-267accb43184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9d04a8-5570-4ee3-a51a-267accb43184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295bc5d0-288f-4eaf-b7a2-71760d47c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:00 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Volume 92bc1cf2-91cd-4aac-944b-f29b24fa64c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9', 'volume_size': 1} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2075940892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bc1cf2-91cd-4aac-944b-f29b24fa64c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9255f901354d488bb77fd1022ac9c1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:01Z,use_quota=True,user_id='f753484d5b5046a99609e62ea4ddc694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Creating volume 92bc1cf2-91cd-4aac-944b-f29b24fa64c9 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:00 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Deleted volume successfully. Sep 28 15:12:01 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 1073741824 Sep 28 15:12:01 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2464f8b1-da7b-4cd5-8e8e-d7db7a60cc63 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-70ee5a3c-edb5-4695-b5fb-b684cca9c423-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:02 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 1073741824" returned: 0 in 1.222s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:02 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 Sep 28 15:12:02 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Flow 'volume_create_manager' (d2c1d81f-c96c-4a0d-b54e-d4aa01e509ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5067ba-e215-4692-a5f4-4fe23985c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5067ba-e215-4692-a5f4-4fe23985c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1587512722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4921c58e-3bd2-494a-a931-3dec55c09e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af355173589d4d8597669068517a4b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:02Z,use_quota=True,user_id='c61d712dae064fac9469fb6e9e6d01fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3945f1-76e0-47e3-9f55-033e0be7c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3945f1-76e0-47e3-9f55-033e0be7c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056c4b47-0612-4deb-9ae7-1962f58745ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056c4b47-0612-4deb-9ae7-1962f58745ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4921c58e-3bd2-494a-a931-3dec55c09e32', 'volume_name': 'volume-4921c58e-3bd2-494a-a931-3dec55c09e32', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e9bf8e-175c-43cd-b3f1-7712454c125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e9bf8e-175c-43cd-b3f1-7712454c125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33972d26-9f75-429d-842b-8c6b84ec7795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Volume 4921c58e-3bd2-494a-a931-3dec55c09e32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4921c58e-3bd2-494a-a931-3dec55c09e32', 'volume_size': 1} Sep 28 15:12:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:03 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9" returned: 0 in 0.868s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1587512722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4921c58e-3bd2-494a-a931-3dec55c09e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af355173589d4d8597669068517a4b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:02Z,use_quota=True,user_id='c61d712dae064fac9469fb6e9e6d01fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Creating volume 4921c58e-3bd2-494a-a931-3dec55c09e32 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:03 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=127,cinder:SELECT=96,cinder:INSERT=34,cinder:DELETE=14 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:03 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 1073741824 Sep 28 15:12:03 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295bc5d0-288f-4eaf-b7a2-71760d47c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95180f9-2304-4b6e-aef0-d4dd8bfacd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=136,cinder:INSERT=37,cinder:DELETE=10,cinder:SELECT=86 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Volume volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 (92bc1cf2-91cd-4aac-944b-f29b24fa64c9): created successfully Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95180f9-2304-4b6e-aef0-d4dd8bfacd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Flow 'volume_create_manager' (2e60729b-fd76-439f-8624-7803f3f8f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:03 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bdf8f2ba-6e91-4e44-ba95-37539d7ed06c tempest-VolumesListAdminTestJSON-1475066826 None] Created volume successfully. Sep 28 15:12:04 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 1073741824" returned: 0 in 1.149s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:04 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 Sep 28 15:12:04 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:05 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32" returned: 0 in 0.805s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33972d26-9f75-429d-842b-8c6b84ec7795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4921c58e-3bd2-494a-a931-3dec55c09e32', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11befecc-8944-4227-9dc9-754ed0632c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Volume volume-4921c58e-3bd2-494a-a931-3dec55c09e32 (4921c58e-3bd2-494a-a931-3dec55c09e32): created successfully Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11befecc-8944-4227-9dc9-754ed0632c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Flow 'volume_create_manager' (d2c1d81f-c96c-4a0d-b54e-d4aa01e509ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-85c4fe63-6530-4f9a-a1e3-c2893aa42a94 tempest-VolumesTransfersV357Test-1692126886 None] Created volume successfully. Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Flow 'volume_create_manager' (04bc4e27-6595-4f07-b578-5142de2511f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc3c77-6c3b-4e04-9f97-85adccc03663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc3c77-6c3b-4e04-9f97-85adccc03663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1706465840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75da1785-3130-4f66-a321-893bc8e05b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9255f901354d488bb77fd1022ac9c1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:05Z,use_quota=True,user_id='f753484d5b5046a99609e62ea4ddc694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491f5451-ca00-4e18-9721-c903d309da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491f5451-ca00-4e18-9721-c903d309da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1bdcb7-b733-406c-8009-cddc86443b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1bdcb7-b733-406c-8009-cddc86443b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75da1785-3130-4f66-a321-893bc8e05b81', 'volume_name': 'volume-75da1785-3130-4f66-a321-893bc8e05b81', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcba7fd1-0b2a-42bc-8de3-170bc9179496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcba7fd1-0b2a-42bc-8de3-170bc9179496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431618cb-9ad8-4b85-8ade-09089c85e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Volume 75da1785-3130-4f66-a321-893bc8e05b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75da1785-3130-4f66-a321-893bc8e05b81', 'volume_size': 1} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1706465840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75da1785-3130-4f66-a321-893bc8e05b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9255f901354d488bb77fd1022ac9c1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:05Z,use_quota=True,user_id='f753484d5b5046a99609e62ea4ddc694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Creating volume 75da1785-3130-4f66-a321-893bc8e05b81 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:05 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:05 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 1073741824 Sep 28 15:12:05 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:06 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 1073741824" returned: 0 in 0.547s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:06 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 Sep 28 15:12:06 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:06 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431618cb-9ad8-4b85-8ade-09089c85e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75da1785-3130-4f66-a321-893bc8e05b81', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1707b214-9822-466d-9bad-5aa3e9df3e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Volume volume-75da1785-3130-4f66-a321-893bc8e05b81 (75da1785-3130-4f66-a321-893bc8e05b81): created successfully Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1707b214-9822-466d-9bad-5aa3e9df3e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Flow 'volume_create_manager' (04bc4e27-6595-4f07-b578-5142de2511f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a9288e39-7650-4e3c-bb4c-f433cd37c38a tempest-VolumesListAdminTestJSON-1475066826 None] Created volume successfully. Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Acquiring lock "cinder-4921c58e-3bd2-494a-a931-3dec55c09e32-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-4921c58e-3bd2-494a-a931-3dec55c09e32-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Acquiring lock "cinder-quobyte-4921c58e-3bd2-494a-a931-3dec55c09e32" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-quobyte-4921c58e-3bd2-494a-a931-3dec55c09e32" acquired by "delete_volume" :: waited 0.043s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4aba62-f25a-42a6-8fb0-33542103c682]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:07 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 Sep 28 15:12:07 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:07 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32" returned: 0 in 0.654s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:08 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32 Sep 28 15:12:08 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Flow 'volume_create_manager' (4c78ec2f-dc65-4043-8398-640fec3aa45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15faf24-770a-4729-b1a5-d3c9c3642796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15faf24-770a-4729-b1a5-d3c9c3642796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1661709645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594f93b5-f6f9-4bfb-a422-dc18343359d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9255f901354d488bb77fd1022ac9c1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:08Z,use_quota=True,user_id='f753484d5b5046a99609e62ea4ddc694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf090aa-6c96-4de0-bd48-bc58c21e955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf090aa-6c96-4de0-bd48-bc58c21e955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a7cdb7-9276-47f6-866c-a066beca0bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:08 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a7cdb7-9276-47f6-866c-a066beca0bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594f93b5-f6f9-4bfb-a422-dc18343359d5', 'volume_name': 'volume-594f93b5-f6f9-4bfb-a422-dc18343359d5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd16696-76c0-4566-88ac-c119ac41e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd16696-76c0-4566-88ac-c119ac41e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaabffc-05e9-448e-9698-253d8e615855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Volume 594f93b5-f6f9-4bfb-a422-dc18343359d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594f93b5-f6f9-4bfb-a422-dc18343359d5', 'volume_size': 1} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1661709645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594f93b5-f6f9-4bfb-a422-dc18343359d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9255f901354d488bb77fd1022ac9c1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:08Z,use_quota=True,user_id='f753484d5b5046a99609e62ea4ddc694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Creating volume 594f93b5-f6f9-4bfb-a422-dc18343359d5 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:08 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4921c58e-3bd2-494a-a931-3dec55c09e32" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:08 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 1073741824 Sep 28 15:12:08 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-quobyte-4921c58e-3bd2-494a-a931-3dec55c09e32" released by "delete_volume" :: held 1.177s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Created reservations ['ebcb483a-eccd-49bc-a43a-714807308467', '85ad293f-587b-45e7-a36c-8e7aa505c33f', '947700f8-6558-42db-9f72-d4f258c3d40f', '0e5186e3-8714-4859-9c99-30341eabec76'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:08 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:08 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:08 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.339s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Deleted volume successfully. Sep 28 15:12:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe7606c5-e687-4e2c-adf0-63ef7487cdc7 tempest-VolumesTransfersV357Test-1176826710 None] Lock "cinder-4921c58e-3bd2-494a-a931-3dec55c09e32-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:09 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 1073741824" returned: 0 in 0.668s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 Sep 28 15:12:09 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5" returned: 0 in 0.396s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaabffc-05e9-448e-9698-253d8e615855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594f93b5-f6f9-4bfb-a422-dc18343359d5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c669b5-b248-4a07-b7b7-fdc1f3993b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:09 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Volume volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 (594f93b5-f6f9-4bfb-a422-dc18343359d5): created successfully Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c669b5-b248-4a07-b7b7-fdc1f3993b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Flow 'volume_create_manager' (4c78ec2f-dc65-4043-8398-640fec3aa45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-37c55115-581d-4e88-a383-6aeb2c137ca0 tempest-VolumesListAdminTestJSON-1475066826 None] Created volume successfully. Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Flow 'volume_create_manager' (148fe4f8-47c9-4cab-a617-e893e9309aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f8605a-58e1-4844-a771-907979b8ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f8605a-58e1-4844-a771-907979b8ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc58be97-9589-4246-aac4-b4014b8dcbf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e4422d069a45fa870bf82f1ce635d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:12Z,use_quota=True,user_id='b81f8ca2724a47889c5ee76a272e8c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a92c9f5-967d-46c2-a0bd-01f8435fd092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a92c9f5-967d-46c2-a0bd-01f8435fd092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fed4d93-47f0-436d-9853-a7c883c3626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fed4d93-47f0-436d-9853-a7c883c3626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc58be97-9589-4246-aac4-b4014b8dcbf5', 'volume_name': 'volume-bc58be97-9589-4246-aac4-b4014b8dcbf5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68293b95-ba1a-41bd-a3bf-6503d8420b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68293b95-ba1a-41bd-a3bf-6503d8420b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d09194-c4ad-42e5-bbb3-41b1de50db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Volume bc58be97-9589-4246-aac4-b4014b8dcbf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc58be97-9589-4246-aac4-b4014b8dcbf5', 'volume_size': 1} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc58be97-9589-4246-aac4-b4014b8dcbf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e4422d069a45fa870bf82f1ce635d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:12Z,use_quota=True,user_id='b81f8ca2724a47889c5ee76a272e8c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Creating volume bc58be97-9589-4246-aac4-b4014b8dcbf5 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:11 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:11 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 1073741824 Sep 28 15:12:11 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:12 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 1073741824" returned: 0 in 0.794s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:12 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 Sep 28 15:12:12 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:12 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5" returned: 0 in 0.335s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d09194-c4ad-42e5-bbb3-41b1de50db57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc58be97-9589-4246-aac4-b4014b8dcbf5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9148ad-74d8-4ae4-9af9-68e6641debf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:13 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Volume volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 (bc58be97-9589-4246-aac4-b4014b8dcbf5): created successfully Sep 28 15:12:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9148ad-74d8-4ae4-9af9-68e6641debf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Flow 'volume_create_manager' (148fe4f8-47c9-4cab-a617-e893e9309aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:13 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-201a6602-5d45-4bde-bc18-1ed57e485e8f tempest-VolumesListAdminTestJSON-1563482718 None] Created volume successfully. Sep 28 15:12:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Acquiring lock "cinder-bc58be97-9589-4246-aac4-b4014b8dcbf5-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Lock "cinder-bc58be97-9589-4246-aac4-b4014b8dcbf5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Acquiring lock "cinder-quobyte-bc58be97-9589-4246-aac4-b4014b8dcbf5" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Lock "cinder-quobyte-bc58be97-9589-4246-aac4-b4014b8dcbf5" acquired by "delete_volume" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d729bd-c8a1-4005-9405-efdea500aa10]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "cinder-594f93b5-f6f9-4bfb-a422-dc18343359d5-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-594f93b5-f6f9-4bfb-a422-dc18343359d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "cinder-quobyte-594f93b5-f6f9-4bfb-a422-dc18343359d5" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-quobyte-594f93b5-f6f9-4bfb-a422-dc18343359d5" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea71364-a728-4154-9200-7b2ceb39842e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 Sep 28 15:12:14 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:14 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 Sep 28 15:12:14 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:14 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5" returned: 0 in 0.727s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5 Sep 28 15:12:14 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:14 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5 Sep 28 15:12:14 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-594f93b5-f6f9-4bfb-a422-dc18343359d5" returned: 0 in 0.321s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-quobyte-594f93b5-f6f9-4bfb-a422-dc18343359d5" released by "delete_volume" :: held 0.882s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:15 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Created reservations ['b342074b-a134-4d7e-991d-23bfe935a4d3', '0f281591-69fb-4964-9e23-2b62d9636c33', '7200da73-142d-4fab-92a7-b94a8b1d5f69', '97e06700-37c0-4172-8109-2febaa4e221e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bc58be97-9589-4246-aac4-b4014b8dcbf5" returned: 0 in 0.407s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Lock "cinder-quobyte-bc58be97-9589-4246-aac4-b4014b8dcbf5" released by "delete_volume" :: held 1.206s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Created reservations ['b2c37ba7-d37d-454f-acda-883caaa98418', 'a34ae32a-9e1e-4b70-957f-51833a15a638', '874a67a4-9245-4f9e-9744-2eee629f9829', 'd84fc1ef-0b82-4957-ac1e-84bfa7e414b7'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:15 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:15 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "cinder-75da1785-3130-4f66-a321-893bc8e05b81-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:15 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-75da1785-3130-4f66-a321-893bc8e05b81-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "cinder-quobyte-75da1785-3130-4f66-a321-893bc8e05b81" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-quobyte-75da1785-3130-4f66-a321-893bc8e05b81" acquired by "delete_volume" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac05d028-13d9-4216-9cf7-b948a0990d21]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.591s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Deleted volume successfully. Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-775273db-fb2a-4d11-bab4-f40dd83edefc tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-594f93b5-f6f9-4bfb-a422-dc18343359d5-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:16 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 Sep 28 15:12:16 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.432s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Deleted volume successfully. Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d6fd9136-657e-44e8-9ecd-6c6437dd8034 tempest-VolumesListAdminTestJSON-1563482718 None] Lock "cinder-bc58be97-9589-4246-aac4-b4014b8dcbf5-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:16 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81" returned: 0 in 0.700s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81 Sep 28 15:12:16 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:17 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75da1785-3130-4f66-a321-893bc8e05b81" returned: 0 in 0.406s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-quobyte-75da1785-3130-4f66-a321-893bc8e05b81" released by "delete_volume" :: held 1.192s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Created reservations ['73edb17b-f06e-44fd-8d4b-0e979115be48', '3db08866-c65d-4600-934a-c4a7af0f41a5', '6a6498f7-4b70-4486-bec4-e9a8ba5299da', '893d66b1-89de-455f-980a-09e94067521f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:17 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:17 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:17 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.334s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Deleted volume successfully. Sep 28 15:12:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-191c1ee9-400c-4a02-b977-9cd03f2edcba tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-75da1785-3130-4f66-a321-893bc8e05b81-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "cinder-92bc1cf2-91cd-4aac-944b-f29b24fa64c9-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-92bc1cf2-91cd-4aac-944b-f29b24fa64c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-028929e9-702e-4224-8d1c-a4044852a4f3 req-b668a366-0d97-4dba-84e7-13a43850da5e tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-028929e9-702e-4224-8d1c-a4044852a4f3 req-b668a366-0d97-4dba-84e7-13a43850da5e tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-028929e9-702e-4224-8d1c-a4044852a4f3 req-b668a366-0d97-4dba-84e7-13a43850da5e tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "cinder-quobyte-92bc1cf2-91cd-4aac-944b-f29b24fa64c9" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-quobyte-92bc1cf2-91cd-4aac-944b-f29b24fa64c9" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-028929e9-702e-4224-8d1c-a4044852a4f3 req-b668a366-0d97-4dba-84e7-13a43850da5e tempest-TestServerVolumeAttachmentScenario-609627885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-ad6328cf-31c6-464c-bef5-5d230966a4af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aaf2af02-6cee-4ad0-a207-8da1af8eb40c', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79669c0-a30b-46c2-9233-53b905ff3018]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-028929e9-702e-4224-8d1c-a4044852a4f3 req-b668a366-0d97-4dba-84e7-13a43850da5e tempest-TestServerVolumeAttachmentScenario-609627885 None] attachment_update completed successfully. Sep 28 15:12:18 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 Sep 28 15:12:18 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:18 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9" returned: 0 in 0.651s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:19 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9 Sep 28 15:12:19 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:19 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-92bc1cf2-91cd-4aac-944b-f29b24fa64c9" returned: 0 in 0.432s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-quobyte-92bc1cf2-91cd-4aac-944b-f29b24fa64c9" released by "delete_volume" :: held 1.179s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Created reservations ['f0ac0f13-4b68-49bf-b698-94f7c4e1aee2', '659dfc47-8414-4349-9229-0c822cc85e43', '40893b0b-1d7a-4210-8c8d-7d9441dcb14e', '4f9203cb-bd01-42e7-a003-a3da344db90a'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:19 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:19 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:20 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.404s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:20 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Deleted volume successfully. Sep 28 15:12:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-48ffddae-099c-4fd5-a23e-470ea2edd739 tempest-VolumesListAdminTestJSON-1475066826 None] Lock "cinder-92bc1cf2-91cd-4aac-944b-f29b24fa64c9-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Acquiring lock "cinder-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Lock "cinder-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Acquiring lock "cinder-quobyte-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Lock "cinder-quobyte-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:21 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ac925-8f37-498f-93aa-16b18c9564d3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 Sep 28 15:12:21 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1" returned: 0 in 0.538s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:22 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1 Sep 28 15:12:22 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Lock "cinder-quobyte-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1" released by "delete_volume" :: held 0.935s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Created reservations ['f2b7615d-5e39-48b3-bb03-ee48cdb1dc61', 'b1f01e6e-d55d-413a-9525-3c1f545c1026', 'd3cdd5b9-7e98-4d92-8e4f-d18bb56d7032', 'f1d6c943-fe00-4dbb-a61f-057038c547f9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:22 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:22 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:23 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.347s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:23 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Deleted volume successfully. Sep 28 15:12:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-219eed73-be88-47ba-b45a-e052bee82b55 tempest-VolumesNegativeTest-1531426662 None] Lock "cinder-058a8e1e-6f8e-4cff-ac9b-6d324a82bdc1-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-dc7aecdb-8733-4e77-8d4a-a813f3ea88ad req-d2b4596e-ace7-41e3-b43e-0da57389144c tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-dc7aecdb-8733-4e77-8d4a-a813f3ea88ad req-d2b4596e-ace7-41e3-b43e-0da57389144c tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-dc7aecdb-8733-4e77-8d4a-a813f3ea88ad req-d2b4596e-ace7-41e3-b43e-0da57389144c tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-dc7aecdb-8733-4e77-8d4a-a813f3ea88ad req-d2b4596e-ace7-41e3-b43e-0da57389144c tempest-TestServerVolumeAttachmentScenario-609627885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-389f3762-c178-4db8-9eab-a2f125c5a775', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '536e0b4b-3cbd-4a6b-8b76-cb4f1b3ece5b', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:12:27 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-dc7aecdb-8733-4e77-8d4a-a813f3ea88ad req-d2b4596e-ace7-41e3-b43e-0da57389144c tempest-TestServerVolumeAttachmentScenario-609627885 None] attachment_update completed successfully. Sep 28 15:12:28 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Flow 'volume_create_manager' (ea76aa1d-f83c-484b-a9c2-8c51c0c8d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dfe92-14d1-4c6a-9ab0-ec22408101da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dfe92-14d1-4c6a-9ab0-ec22408101da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1171985305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da332e5-4c5a-4188-8346-3ac9e4913b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f29b140fa54484f9fd93f6c228ffb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:29Z,use_quota=True,user_id='ab5b7334695440108d3fdc2e8a507ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9aa601-8cff-4391-a3a4-abf975691c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9aa601-8cff-4391-a3a4-abf975691c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fc3ce3-7ce9-4b1e-8cc9-c27583ce148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fc3ce3-7ce9-4b1e-8cc9-c27583ce148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da332e5-4c5a-4188-8346-3ac9e4913b97', 'volume_name': 'volume-5da332e5-4c5a-4188-8346-3ac9e4913b97', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7562652d-99fc-4867-aa28-cca97ee067da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7562652d-99fc-4867-aa28-cca97ee067da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81eb428-1169-4258-a11a-08421e77b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Volume 5da332e5-4c5a-4188-8346-3ac9e4913b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da332e5-4c5a-4188-8346-3ac9e4913b97', 'volume_size': 1} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1171985305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da332e5-4c5a-4188-8346-3ac9e4913b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f29b140fa54484f9fd93f6c228ffb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:29Z,use_quota=True,user_id='ab5b7334695440108d3fdc2e8a507ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Creating volume 5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:29 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:29 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 1073741824 Sep 28 15:12:29 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:29 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 1073741824" returned: 0 in 0.753s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:29 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 Sep 28 15:12:29 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:30 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-b266e1b1-db39-4242-a927-bcb2e6111d6f req-af85aaaf-2613-460c-bbee-33577fa3c091 tempest-TestServerVolumeAttachmentScenario-609627885 None] Terminate volume connection completed successfully. Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-b266e1b1-db39-4242-a927-bcb2e6111d6f req-af85aaaf-2613-460c-bbee-33577fa3c091 tempest-TestServerVolumeAttachmentScenario-609627885 None] Deleting attachment 536e0b4b-3cbd-4a6b-8b76-cb4f1b3ece5b. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:12:30 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97" returned: 0 in 0.461s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81eb428-1169-4258-a11a-08421e77b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da332e5-4c5a-4188-8346-3ac9e4913b97', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5617ae1e-80b8-45d4-96c4-3d2b447371ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:30 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Volume volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 (5da332e5-4c5a-4188-8346-3ac9e4913b97): created successfully Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5617ae1e-80b8-45d4-96c4-3d2b447371ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Flow 'volume_create_manager' (ea76aa1d-f83c-484b-a9c2-8c51c0c8d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:30 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8229e7d8-9e7d-4158-823a-0508c2a8d1cb tempest-VolumesSnapshotListTestJSON-231020573 None] Created volume successfully. Sep 28 15:12:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Creating offline snapshot 8b235cfd-71f4-4a7e-994f-3e32920e04a2 of volume 5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef01833-c180-4b3b-8ece-a2bee78aef37]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:31 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 Sep 28 15:12:31 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:32 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-d403e55c-95ca-4ecd-b892-3aae748fb306 req-7f85c2d8-93db-4f5b-8cc1-b45527efe0b1 tempest-TestServerVolumeAttachmentScenario-609627885 None] Terminate volume connection completed successfully. Sep 28 15:12:32 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-d403e55c-95ca-4ecd-b892-3aae748fb306 req-7f85c2d8-93db-4f5b-8cc1-b45527efe0b1 tempest-TestServerVolumeAttachmentScenario-609627885 None] Deleting attachment aaf2af02-6cee-4ad0-a207-8da1af8eb40c. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:12:32 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97" returned: 0 in 0.601s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:32 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 1G Sep 28 15:12:32 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:33 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 1G" returned: 0 in 1.003s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:33 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 Sep 28 15:12:33 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:33 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:33 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2" returned: 0 in 0.769s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 is being set with open permissions: ugo+rw Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 Sep 28 15:12:34 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.607s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:12:34 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2" returned: 0 in 0.379s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.info Sep 28 15:12:34 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:35 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.info" returned: 0 in 0.484s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:35 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.info is being set with open permissions: ugo+rw Sep 28 15:12:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:35 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.info Sep 28 15:12:35 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:35 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.info" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.837s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c48cc830-ef02-4fe0-a30d-b87c44cd4267 tempest-VolumesSnapshotListTestJSON-231020573 None] Create snapshot completed successfully Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Flow 'volume_create_manager' (e98064a9-4340-4970-bf2a-2b33a54295e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddd9c73-5b13-4be3-88e1-4db4978fcb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Creating offline snapshot 336e42fc-00ec-4344-b66d-b466d7830729 of volume 5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddd9c73-5b13-4be3-88e1-4db4978fcb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1894871832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf66876b-b18e-42d2-a33d-c5e2ebd053eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488a32cf3984e0fa7fb8273df9f88d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:36Z,use_quota=True,user_id='49b3145926e544cb83b1a38315808006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2895e494-3a5a-4141-978a-f74fc2fd1242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2895e494-3a5a-4141-978a-f74fc2fd1242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6437c0d-aa91-4d35-a726-3c7fc6ff18c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c17b76-c816-4fe9-b080-2a2d0894dec9]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:36 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 Sep 28 15:12:36 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6437c0d-aa91-4d35-a726-3c7fc6ff18c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf66876b-b18e-42d2-a33d-c5e2ebd053eb', 'volume_name': 'volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f18505c-5ee7-4f13-9226-354dd90aa248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f18505c-5ee7-4f13-9226-354dd90aa248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d4d5ad-3e74-4bee-bfbd-405ae16c0e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:36 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Volume cf66876b-b18e-42d2-a33d-c5e2ebd053eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:12:36 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Trying to clone cf66876b-b18e-42d2-a33d-c5e2ebd053eb from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd at location (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:12:37 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2" returned: 0 in 0.734s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da332e5-4c5a-4188-8346-3ac9e4913b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:37 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 1G Sep 28 15:12:37 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:37 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:12:37 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:12:37 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2dc2b0-7966-4ef7-b309-0a504c2a2396]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:37 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD Sep 28 15:12:37 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:38 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 1G" returned: 0 in 0.850s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:38 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 Sep 28 15:12:38 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:38 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd is fetched for user 49b3145926e544cb83b1a38315808006. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b302ba9-20d9-4b35-9fcd-db7eba649339]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:38 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729" returned: 0 in 0.402s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:38 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 is being set with open permissions: ugo+rw Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:38 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 Sep 28 15:12:38 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:38 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD Sep 28 15:12:38 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:38 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:38 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729" returned: 0 in 0.476s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1894871832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf66876b-b18e-42d2-a33d-c5e2ebd053eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a488a32cf3984e0fa7fb8273df9f88d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:36Z,use_quota=True,user_id='49b3145926e544cb83b1a38315808006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Creating volume cf66876b-b18e-42d2-a33d-c5e2ebd053eb {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:39 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb 1073741824 Sep 28 15:12:39 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:39 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-46c5b155-fd7a-4f87-b51b-f76fb273d7fc tempest-VolumesSnapshotListTestJSON-231020573 None] Create snapshot completed successfully Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:39 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb 1073741824" returned: 0 in 0.821s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "cinder-389f3762-c178-4db8-9eab-a2f125c5a775-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:39 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb Sep 28 15:12:39 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-389f3762-c178-4db8-9eab-a2f125c5a775-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "cinder-quobyte-389f3762-c178-4db8-9eab-a2f125c5a775" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-quobyte-389f3762-c178-4db8-9eab-a2f125c5a775" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3301f6-0eca-4692-bda3-d762f1d25767]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 Sep 28 15:12:40 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:40 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb" returned: 0 in 0.319s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.482s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Creating offline snapshot edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 of volume 5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Attempting download of 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume cf66876b-b18e-42d2-a33d-c5e2ebd053eb. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfecc4e-eb0b-46b1-a4e7-5314e1d5f9e9]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[570cc4da-611d-43f8-9504-05d62a09bbb5]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_r6o148ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 Sep 28 15:12:40 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:40 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_r6o148ae Sep 28 15:12:40 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:40 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775" returned: 0 in 0.527s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775 Sep 28 15:12:40 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:40 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729" returned: 0 in 0.569s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da332e5-4c5a-4188-8346-3ac9e4913b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_r6o148ae" returned: 0 in 0.519s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_r6o148ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 1G Sep 28 15:12:40 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:40 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-389f3762-c178-4db8-9eab-a2f125c5a775" returned: 0 in 0.383s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-quobyte-389f3762-c178-4db8-9eab-a2f125c5a775" released by "delete_volume" :: held 0.966s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Created reservations ['ed484546-e49c-4867-961a-f53986900dea', '98247264-ae37-436a-95a3-aa3fdb098808', '187cb0fe-8c8b-4b56-a7ce-0e678f3b1060', '5cd99e14-ef7e-40ec-8bf1-89746cf4fa88'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:41 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_r6o148ae Sep 28 15:12:41 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:41 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:41 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:41 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_r6o148ae" returned: 1 in 0.618s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_r6o148ae' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[21323390-368b-4ab3-a02e-9dc6af06884b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:41 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Deleted volume successfully. Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-90261ce7-2319-4bb8-b502-9c3cb38b4e3b tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-389f3762-c178-4db8-9eab-a2f125c5a775-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:41 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD Sep 28 15:12:41 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:41 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 1G" returned: 0 in 0.838s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:41 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 Sep 28 15:12:41 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:41 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd was qcow2, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:12:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:42 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb Sep 28 15:12:42 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:42 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" returned: 0 in 0.334s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:42 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 is being set with open permissions: ugo+rw Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:42 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 Sep 28 15:12:42 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "cinder-ad6328cf-31c6-464c-bef5-5d230966a4af-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-ad6328cf-31c6-464c-bef5-5d230966a4af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "cinder-quobyte-ad6328cf-31c6-464c-bef5-5d230966a4af" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-quobyte-ad6328cf-31c6-464c-bef5-5d230966a4af" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:42 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1502df-64dd-4dac-b0db-ae83b9e4a4ef]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d423dba9-b0c8-47fe-80bd-3ffb333290a0 tempest-VolumesSnapshotListTestJSON-231020573 None] Create snapshot completed successfully Sep 28 15:12:42 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af Sep 28 15:12:42 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:43 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af" returned: 0 in 0.649s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:43 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af Sep 28 15:12:43 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:43 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ad6328cf-31c6-464c-bef5-5d230966a4af" returned: 0 in 0.508s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-quobyte-ad6328cf-31c6-464c-bef5-5d230966a4af" released by "delete_volume" :: held 1.214s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Created reservations ['38c615c5-896a-4542-b48c-3c20af951eb3', '6c29078d-f413-43ef-acea-1a9aac512497', '568a4765-f190-4f05-b841-ca2e28dae0a1', '478aa32f-ff2e-47db-b2dd-90785b2a8ead'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:43 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:43 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:44 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.340s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Deleted volume successfully. Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a2981e9-9c8f-4c18-9ff1-ad4f96e0ffbb tempest-TestServerVolumeAttachmentScenario-609627885 None] Lock "cinder-ad6328cf-31c6-464c-bef5-5d230966a4af-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-edd84132-d6aa-4a3e-8f97-49fbdd41a1f9-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-edd84132-d6aa-4a3e-8f97-49fbdd41a1f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-quobyte-edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Deleting offline snapshot edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 of volume 5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] snapshot_file for this snap is: volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa8d905-2aaa-49d2-8fce-5c16939d47c4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:44 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 Sep 28 15:12:44 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:44 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb" returned: 0 in 2.995s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_vpuqvv4rdevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:12:44 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Converted 112.00 MB image at 37.38 MB/s Sep 28 15:12:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:45 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb 1G Sep 28 15:12:45 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:45 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" returned: 0 in 0.531s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da332e5-4c5a-4188-8346-3ac9e4913b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6094f98-90a8-4756-8bb6-e2d18a2a5daa]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:45 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 Sep 28 15:12:45 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:45 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb 1G" returned: 0 in 0.564s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Downloaded image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume cf66876b-b18e-42d2-a33d-c5e2ebd053eb successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd for user 49b3145926e544cb83b1a38315808006 is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Marking volume cf66876b-b18e-42d2-a33d-c5e2ebd053eb as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Copying metadata from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd to cf66876b-b18e-42d2-a33d-c5e2ebd053eb. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Creating volume glance metadata for volume cf66876b-b18e-42d2-a33d-c5e2ebd053eb backed by image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d4d5ad-3e74-4bee-bfbd-405ae16c0e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70ee29b-2c2d-4270-9dc4-7b9f9bb62c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Volume volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb (cf66876b-b18e-42d2-a33d-c5e2ebd053eb): created successfully Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70ee29b-2c2d-4270-9dc4-7b9f9bb62c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Flow 'volume_create_manager' (e98064a9-4340-4970-bf2a-2b33a54295e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e0274222-1e96-459f-bcc9-b2d115db6cab tempest-VolumesImageMetadata-903846839 None] Created volume successfully. Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (5f85da0d-1dff-4d56-96f3-6948745debe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:45 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea280ba0-a9ac-46ba-8408-d0c397465174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729" returned: 0 in 0.521s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da332e5-4c5a-4188-8346-3ac9e4913b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea280ba0-a9ac-46ba-8408-d0c397465174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1194675221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be111011-785f-43ac-a6c2-57dcc3218eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:46Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 Sep 28 15:12:45 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590ddd5d-6049-4bea-a280-81f34398d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590ddd5d-6049-4bea-a280-81f34398d910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceed8192-3371-40f0-98b9-69be701a1d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceed8192-3371-40f0-98b9-69be701a1d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be111011-785f-43ac-a6c2-57dcc3218eb7', 'volume_name': 'volume-be111011-785f-43ac-a6c2-57dcc3218eb7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68302613-a1ab-4046-b79c-da34c3cd1e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68302613-a1ab-4046-b79c-da34c3cd1e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75219f2f-384a-4a97-8dc6-1246f25f775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Volume be111011-785f-43ac-a6c2-57dcc3218eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be111011-785f-43ac-a6c2-57dcc3218eb7', 'volume_size': 1} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1194675221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be111011-785f-43ac-a6c2-57dcc3218eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:46Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Creating volume be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:45 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:45 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 1073741824 Sep 28 15:12:45 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:46 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" returned: 0 in 0.522s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:46 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9 Sep 28 15:12:46 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:46 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 1073741824" returned: 0 in 0.567s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:46 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 Sep 28 15:12:46 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:46 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" returned: 0 in 0.327s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-edd84132-d6aa-4a3e-8f97-49fbdd41a1f9" released by "_delete_snapshot" :: held 2.088s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" released by "delete_snapshot" :: held 2.134s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Created reservations ['711c2bc1-2b7d-4cef-8887-1b165a3af4ab', 'c119a08d-1a3b-44e7-b6b3-2fa4098e6e80', 'd7f96316-50cf-4f7b-abad-3942e016f501', '5704d6f3-92dc-4be4-9fd6-2ebc9381f4a2'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:46 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7" returned: 0 in 0.373s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75219f2f-384a-4a97-8dc6-1246f25f775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be111011-785f-43ac-a6c2-57dcc3218eb7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa64dc5-fe6d-4cd5-81e9-3e21398a7354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:46 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Volume volume-be111011-785f-43ac-a6c2-57dcc3218eb7 (be111011-785f-43ac-a6c2-57dcc3218eb7): created successfully Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa64dc5-fe6d-4cd5-81e9-3e21398a7354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (5f85da0d-1dff-4d56-96f3-6948745debe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Acquiring lock "cinder-cf66876b-b18e-42d2-a33d-c5e2ebd053eb-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-690bc386-0d04-45e7-9ffc-73b6ceb636cb tempest-VolumesSnapshotTestJSON-984781315 None] Created volume successfully. Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Lock "cinder-cf66876b-b18e-42d2-a33d-c5e2ebd053eb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Delete snapshot completed successfully. Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c2a8d0e1-f91c-44ee-9a54-d2b380106716 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-edd84132-d6aa-4a3e-8f97-49fbdd41a1f9-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Acquiring lock "cinder-quobyte-cf66876b-b18e-42d2-a33d-c5e2ebd053eb" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Lock "cinder-quobyte-cf66876b-b18e-42d2-a33d-c5e2ebd053eb" acquired by "delete_volume" :: waited 0.013s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[118d913d-bd68-40b5-a76f-f62c0cf66eb1]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:47 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb Sep 28 15:12:47 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:47 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb" returned: 0 in 0.419s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:47 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb Sep 28 15:12:47 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-336e42fc-00ec-4344-b66d-b466d7830729-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-336e42fc-00ec-4344-b66d-b466d7830729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-quobyte-336e42fc-00ec-4344-b66d-b466d7830729" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-336e42fc-00ec-4344-b66d-b466d7830729" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:48 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Deleting offline snapshot 336e42fc-00ec-4344-b66d-b466d7830729 of volume 5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] snapshot_file for this snap is: volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cf66876b-b18e-42d2-a33d-c5e2ebd053eb" returned: 0 in 0.447s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4fa44c-ed17-458a-b156-d73699ee5676]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Lock "cinder-quobyte-cf66876b-b18e-42d2-a33d-c5e2ebd053eb" released by "delete_volume" :: held 0.935s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Created reservations ['5e2ee01e-5365-4e96-b9c3-5ce0f324e571', '63b8b79d-6b30-4e76-a2ad-06e82ea45f94', 'af812931-8a50-4150-bc22-eb81d86c8991', '22d68b6c-6273-454a-928c-7f18045797e9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:48 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 Sep 28 15:12:48 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:48 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:48 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Creating offline snapshot 48824577-d6ae-408d-95f4-547d02484a1b of volume be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[221dd1e8-1600-40c1-9b57-75c56635b3b8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:48 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:48 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Deleted volume successfully. Sep 28 15:12:48 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 Sep 28 15:12:48 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f50c0d92-eebc-47db-a502-aad35ded9fab tempest-VolumesImageMetadata-903846839 None] Lock "cinder-cf66876b-b18e-42d2-a33d-c5e2ebd053eb-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:48 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729" returned: 0 in 0.604s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da332e5-4c5a-4188-8346-3ac9e4913b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ceb51f-66fb-494d-a30c-05bbd5894763]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:48 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 Sep 28 15:12:48 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:48 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7" returned: 0 in 0.434s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:48 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b 1G Sep 28 15:12:48 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:49 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2" returned: 0 in 0.431s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da332e5-4c5a-4188-8346-3ac9e4913b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:49 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 Sep 28 15:12:49 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:49 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b 1G" returned: 0 in 0.560s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be111011-785f-43ac-a6c2-57dcc3218eb7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:49 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be111011-785f-43ac-a6c2-57dcc3218eb7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b Sep 28 15:12:49 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:49 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729" returned: 0 in 0.632s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:49 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729 Sep 28 15:12:49 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:49 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be111011-785f-43ac-a6c2-57dcc3218eb7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b" returned: 0 in 0.453s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:49 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b is being set with open permissions: ugo+rw Sep 28 15:12:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:50 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b Sep 28 15:12:50 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:50 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.336e42fc-00ec-4344-b66d-b466d7830729" returned: 0 in 0.397s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-336e42fc-00ec-4344-b66d-b466d7830729" released by "_delete_snapshot" :: held 2.215s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" released by "delete_snapshot" :: held 2.265s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:50 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Created reservations ['1ef1b3f8-0e89-4247-99b2-838043db8f39', '875a51c3-3d65-42cb-9261-cb9876e04337', 'd8cf4e14-1bdd-42c6-ba6a-9dc38624fc66', 'cf1721a9-8c43-4002-8a56-d2ed5526f65c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:50 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.info Sep 28 15:12:50 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:50 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Delete snapshot completed successfully. Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a96d67fd-6428-4b0b-9b15-6164e5f96440 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-336e42fc-00ec-4344-b66d-b466d7830729-delete_snapshot" released by "delete_snapshot" :: held 2.560s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:50 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.info" returned: 0 in 0.366s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:50 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.info is being set with open permissions: ugo+rw Sep 28 15:12:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:50 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.info Sep 28 15:12:50 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:51 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.info" returned: 0 in 0.309s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4f6ed20e-14d2-44e9-83e2-39b38a430c62 tempest-VolumesSnapshotTestJSON-984781315 None] Create snapshot completed successfully Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-8b235cfd-71f4-4a7e-994f-3e32920e04a2-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-8b235cfd-71f4-4a7e-994f-3e32920e04a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-quobyte-8b235cfd-71f4-4a7e-994f-3e32920e04a2" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-8b235cfd-71f4-4a7e-994f-3e32920e04a2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Deleting offline snapshot 8b235cfd-71f4-4a7e-994f-3e32920e04a2 of volume 5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] snapshot_file for this snap is: volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a3ac4f-2739-48a1-9aa4-1c49b00b44fd]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:51 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 Sep 28 15:12:51 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-48824577-d6ae-408d-95f4-547d02484a1b-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-48824577-d6ae-408d-95f4-547d02484a1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:51 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2" returned: 0 in 0.512s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da332e5-4c5a-4188-8346-3ac9e4913b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f923b-1bee-4539-80d0-e0806ff8c27f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-be111011-785f-43ac-a6c2-57dcc3218eb7" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-be111011-785f-43ac-a6c2-57dcc3218eb7" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-48824577-d6ae-408d-95f4-547d02484a1b" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-48824577-d6ae-408d-95f4-547d02484a1b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Deleting offline snapshot 48824577-d6ae-408d-95f4-547d02484a1b of volume be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] snapshot_file for this snap is: volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa954e0e-c40a-4559-a231-e3d045d89d6c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:52 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 Sep 28 15:12:52 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:52 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b Sep 28 15:12:52 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:52 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97" returned: 0 in 0.568s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:52 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 Sep 28 15:12:52 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:52 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b" returned: 0 in 0.570s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be111011-785f-43ac-a6c2-57dcc3218eb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[50887392-56e7-4d62-965d-0527b7ce14d6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:52 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 Sep 28 15:12:52 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:52 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2" returned: 0 in 0.466s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:52 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2 Sep 28 15:12:52 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7" returned: 0 in 0.507s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:53 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b Sep 28 15:12:53 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97.8b235cfd-71f4-4a7e-994f-3e32920e04a2" returned: 0 in 0.332s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-8b235cfd-71f4-4a7e-994f-3e32920e04a2" released by "_delete_snapshot" :: held 2.045s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" released by "delete_snapshot" :: held 2.083s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Created reservations ['c7b947a2-625c-4e83-a208-9cab997544b7', '51faa735-3fac-4873-aa5d-ca49bcd19624', '07da3932-de12-452c-9814-2998e7171beb', '9801a3a3-3d97-4b8f-b0f1-ff3fa2ad60b2'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:53 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Delete snapshot completed successfully. Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83b5bbc3-4d07-4d61-a48f-7b1717f808f8 tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-8b235cfd-71f4-4a7e-994f-3e32920e04a2-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:53 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b" returned: 0 in 0.517s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:53 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b Sep 28 15:12:53 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7.48824577-d6ae-408d-95f4-547d02484a1b" returned: 0 in 0.306s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-48824577-d6ae-408d-95f4-547d02484a1b" released by "_delete_snapshot" :: held 2.080s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-be111011-785f-43ac-a6c2-57dcc3218eb7" released by "delete_snapshot" :: held 2.102s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['1f30f08f-f730-4d99-ba3e-1fbeb7f2915a', '3fe242bf-1351-47fd-b1d9-f50c40c9c58c', 'b0a39bba-62e9-4242-83c5-cbbef310d9f6', '9c90bb89-ea7e-4c9b-a0a4-6f3de2c7da64'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:54 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Delete snapshot completed successfully. Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dbcdd7c3-c4fc-4642-a3ec-b705ac1cbc32 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-48824577-d6ae-408d-95f4-547d02484a1b-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-5da332e5-4c5a-4188-8346-3ac9e4913b97-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-5da332e5-4c5a-4188-8346-3ac9e4913b97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7310512-f2cf-4d4e-aee6-9f63ee56d84c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 Sep 28 15:12:54 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:55 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97" returned: 0 in 0.457s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:55 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97 Sep 28 15:12:55 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:55 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5da332e5-4c5a-4188-8346-3ac9e4913b97" returned: 0 in 0.329s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-quobyte-5da332e5-4c5a-4188-8346-3ac9e4913b97" released by "delete_volume" :: held 0.890s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:55 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Created reservations ['c5b6b965-f166-48dd-8cde-97bfc3193881', 'df0c2468-794a-40d7-9790-a1070e323f29', 'd10d58e4-f7b6-4521-95f9-b80b5c32b4eb', 'e7970c86-eda4-4f5a-ad6a-17922468a1fd'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:55 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (f12a20c1-434d-4556-8c2c-c0fce8e8b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3921268f-4997-46c6-ac7d-fcb9e51410ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3921268f-4997-46c6-ac7d-fcb9e51410ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-100730720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c300ca3-ead7-4c19-9f93-f86f9bc30051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:56Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6264fd-9c3b-49d5-80e1-27dd4514ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6264fd-9c3b-49d5-80e1-27dd4514ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44afc9fe-4e80-429f-bd7c-069e3cd923fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44afc9fe-4e80-429f-bd7c-069e3cd923fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c300ca3-ead7-4c19-9f93-f86f9bc30051', 'volume_name': 'volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03705145-6ada-4f90-a25d-e3a72a5b9d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03705145-6ada-4f90-a25d-e3a72a5b9d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bce4569-1f2c-461b-b3ca-18b8c879df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:56 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Volume 9c300ca3-ead7-4c19-9f93-f86f9bc30051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051', 'volume_size': 1} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-100730720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c300ca3-ead7-4c19-9f93-f86f9bc30051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:56Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Creating volume 9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:56 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:56 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 1073741824 Sep 28 15:12:56 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:56 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:12:56 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:56 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.300s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Deleted volume successfully. Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dd27cc34-eb61-4a52-a6e2-70368983884e tempest-VolumesSnapshotListTestJSON-231020573 None] Lock "cinder-5da332e5-4c5a-4188-8346-3ac9e4913b97-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:56 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 1073741824" returned: 0 in 0.571s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:56 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 Sep 28 15:12:56 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:57 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051" returned: 0 in 0.356s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bce4569-1f2c-461b-b3ca-18b8c879df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5af23ac-b1d4-45ff-b303-a27308f9074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Volume volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 (9c300ca3-ead7-4c19-9f93-f86f9bc30051): created successfully Sep 28 15:12:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5af23ac-b1d4-45ff-b303-a27308f9074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (f12a20c1-434d-4556-8c2c-c0fce8e8b22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:57 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5562b5ad-53eb-408b-8f5a-5a64710858c5 tempest-VolumesSnapshotTestJSON-984781315 None] Created volume successfully. Sep 28 15:12:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Creating offline snapshot c0083ee5-5be0-4310-81af-c7045ba88521 of volume 9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531ce2c-14e7-48ae-9999-0cb5fdda50b8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:58 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 Sep 28 15:12:58 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:58 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051" returned: 0 in 0.577s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:58 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 1G Sep 28 15:12:58 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:59 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 1G" returned: 0 in 0.668s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:59 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 Sep 28 15:12:59 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Flow 'volume_create_manager' (71471371-0356-498c-a364-b1e7673555b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3638f72-2671-44f3-abcb-1c6832f332d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3638f72-2671-44f3-abcb-1c6832f332d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2107919188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f62b39-cd1f-44a7-a37c-b96c52c67cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db921dca9b2941009d027bdd5e540331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:00Z,use_quota=True,user_id='03b242c6c894443b826b3d549238b4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:59 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e4d31f-4f72-4d6d-b2d6-3f9ffeb7aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e4d31f-4f72-4d6d-b2d6-3f9ffeb7aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4842c111-fb5f-4611-afc7-7d964f4cbe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4842c111-fb5f-4611-afc7-7d964f4cbe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f62b39-cd1f-44a7-a37c-b96c52c67cc4', 'volume_name': 'volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a611577f-a9ef-4375-85aa-84235a1a17a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a611577f-a9ef-4375-85aa-84235a1a17a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2496ae-0ab2-430a-bb0f-0be03290291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:00 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Volume 80f62b39-cd1f-44a7-a37c-b96c52c67cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4', 'volume_size': 1} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521" returned: 0 in 0.524s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:00 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 is being set with open permissions: ugo+rw Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:00 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 Sep 28 15:13:00 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:00 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521" returned: 0 in 0.264s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:00 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.info Sep 28 15:13:00 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:00 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.info" returned: 0 in 0.315s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:00 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.info is being set with open permissions: ugo+rw Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:00 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.info Sep 28 15:13:00 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:00 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.info" returned: 0 in 0.306s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.785s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.961s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2107919188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f62b39-cd1f-44a7-a37c-b96c52c67cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db921dca9b2941009d027bdd5e540331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:00Z,use_quota=True,user_id='03b242c6c894443b826b3d549238b4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Creating volume 80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:13:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:01 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 1073741824 Sep 28 15:13:01 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c7dfc58b-2bbe-4486-b789-50c0ff1690f2 tempest-VolumesSnapshotTestJSON-984781315 None] Create snapshot completed successfully Sep 28 15:13:01 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 1073741824" returned: 0 in 0.712s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:01 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 Sep 28 15:13:01 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:02 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2496ae-0ab2-430a-bb0f-0be03290291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e4d794-2821-4c39-b1b4-574c948fcdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Volume volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 (80f62b39-cd1f-44a7-a37c-b96c52c67cc4): created successfully Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e4d794-2821-4c39-b1b4-574c948fcdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Flow 'volume_create_manager' (71471371-0356-498c-a364-b1e7673555b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (b7e958d2-890a-4146-89d7-c8447e5428f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575f5b3d-16b5-44d0-b6e9-28a934dead8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575f5b3d-16b5-44d0-b6e9-28a934dead8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1883026044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b2cba2-1f31-4cc1-ac69-cbe3dad32980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c0083ee5-5be0-4310-81af-c7045ba88521,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:02Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf58677b-9604-4a0d-9029-bac906845add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf58677b-9604-4a0d-9029-bac906845add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3a3fa0-518d-4539-9db2-ebe3a1cb550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3a3fa0-518d-4539-9db2-ebe3a1cb550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1b2cba2-1f31-4cc1-ac69-cbe3dad32980', 'volume_name': 'volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980', 'volume_size': 2, 'snapshot_id': 'c0083ee5-5be0-4310-81af-c7045ba88521'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b92f282-6d7b-47b1-a879-2f53dcd4408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b92f282-6d7b-47b1-a879-2f53dcd4408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a7c93-c746-42ff-bddd-2b4570f9e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Volume e1b2cba2-1f31-4cc1-ac69-cbe3dad32980: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980', 'volume_size': 2, 'snapshot_id': 'c0083ee5-5be0-4310-81af-c7045ba88521'} Sep 28 15:13:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ca54789d-a565-4ea0-af3c-3326c33acd21 tempest-VolumesDeleteCascade-1335777124 None] Created volume successfully. Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-c0083ee5-5be0-4310-81af-c7045ba88521-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-c0083ee5-5be0-4310-81af-c7045ba88521-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Creating volume e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 from snapshot c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] snapshot: c0083ee5-5be0-4310-81af-c7045ba88521, volume: e1b2cba2-1f31-4cc1-ac69-cbe3dad32980, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b5cf0c-a65b-4912-8489-08baa7760766]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:02 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 Sep 28 15:13:02 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:03 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521" returned: 0 in 0.600s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2fcea1-f134-4409-836f-7a8d31f13c05]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:03 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 Sep 28 15:13:03 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=128,cinder:INSERT=39,cinder:UPDATE=147,cinder:DELETE=16 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=137,cinder:DELETE=9,cinder:SELECT=140,cinder:INSERT=42 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:03 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051" returned: 0 in 0.566s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:13:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:03 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 Sep 28 15:13:03 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:12 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" returned: 0 in 8.493s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:13:12 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Converted 1024.00 MB image at 120.54 MB/s Sep 28 15:13:12 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 is being set with open permissions: ugo+rw Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:12 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 Sep 28 15:13:12 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:12 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" returned: 0 in 0.293s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" released by "_copy_volume_from_snapshot" :: held 10.133s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-c0083ee5-5be0-4310-81af-c7045ba88521-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" released by "_create_volume_from_snapshot" :: held 10.217s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.240s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.127s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Creating offline snapshot 7f7e6f13-12a4-416b-9bbe-5d195919ae6b of volume 80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a7c93-c746-42ff-bddd-2b4570f9e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980', 'volume_size': 2, 'snapshot_id': 'c0083ee5-5be0-4310-81af-c7045ba88521'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cd406f-e396-478c-8e66-4f82bd9ea7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0601b403-a5ee-49fb-b313-fde36acb3c53]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Volume volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 (e1b2cba2-1f31-4cc1-ac69-cbe3dad32980): created successfully Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cd406f-e396-478c-8e66-4f82bd9ea7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (b7e958d2-890a-4146-89d7-c8447e5428f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bd35db4e-7d07-4fee-8a48-90baf9e150a6 tempest-VolumesSnapshotTestJSON-984781315 None] Created volume successfully. Sep 28 15:13:12 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 Sep 28 15:13:12 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:13 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" returned: 0 in 0.500s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:13 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b 1G Sep 28 15:13:13 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd911bc6-a531-401b-8ada-43883c4d43e6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:13 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b 1G" returned: 0 in 0.714s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:13 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b Sep 28 15:13:13 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:14 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 Sep 28 15:13:14 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:14 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" returned: 0 in 0.554s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:14 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980 Sep 28 15:13:14 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:14 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b" returned: 0 in 0.452s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b is being set with open permissions: ugo+rw Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:14 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b Sep 28 15:13:14 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:14 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980" released by "delete_volume" :: held 1.086s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:14 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b" returned: 0 in 0.485s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['59a4dd56-0ad4-4210-8fd0-584de90b0b62', 'bd576788-d438-488f-b627-fb431ae78517', '9e95d149-31b0-4e53-a2ce-0a5b1e47322a', 'cb659fda-4556-4e53-96d2-ed4a59b8e72c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:14 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.info Sep 28 15:13:14 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:15 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:13:15 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:15 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.info" returned: 0 in 0.359s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:15 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.info is being set with open permissions: ugo+rw Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:15 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.info Sep 28 15:13:15 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:15 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.383s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Deleted volume successfully. Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-880af213-c638-4376-9e79-718024710318 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-e1b2cba2-1f31-4cc1-ac69-cbe3dad32980-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:15 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.info" returned: 0 in 0.421s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f451c405-950f-47d4-9e12-ad78b927b26b tempest-VolumesDeleteCascade-1335777124 None] Create snapshot completed successfully Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-c0083ee5-5be0-4310-81af-c7045ba88521-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-c0083ee5-5be0-4310-81af-c7045ba88521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-9c300ca3-ead7-4c19-9f93-f86f9bc30051" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-9c300ca3-ead7-4c19-9f93-f86f9bc30051" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-c0083ee5-5be0-4310-81af-c7045ba88521" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-c0083ee5-5be0-4310-81af-c7045ba88521" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Deleting offline snapshot c0083ee5-5be0-4310-81af-c7045ba88521 of volume 9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] snapshot_file for this snap is: volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f881e-c0eb-4ac8-a3f6-433d4b6ccd16]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:16 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 Sep 28 15:13:16 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Creating offline snapshot 6de413cf-0e7b-4459-a18c-43248cd6d07e of volume 80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:16 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521" returned: 0 in 0.688s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3150e6d-2937-4c37-914a-43d171c6697a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e224818-aba0-49ec-b971-714f5698b2ac]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:17 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 Sep 28 15:13:17 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:17 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b Sep 28 15:13:17 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:17 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b" returned: 0 in 0.671s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:17 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e 1G Sep 28 15:13:17 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:17 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051" returned: 0 in 0.750s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:17 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 Sep 28 15:13:17 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:18 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521" returned: 0 in 0.498s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:18 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521 Sep 28 15:13:18 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:18 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e 1G" returned: 0 in 0.742s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:18 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e Sep 28 15:13:18 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:18 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051.c0083ee5-5be0-4310-81af-c7045ba88521" returned: 0 in 0.432s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-c0083ee5-5be0-4310-81af-c7045ba88521" released by "_delete_snapshot" :: held 2.553s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-9c300ca3-ead7-4c19-9f93-f86f9bc30051" released by "delete_snapshot" :: held 2.596s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['5105c326-af53-4d99-9a74-601ef9a3b1b5', '9c2ac942-22fa-4120-9a61-963cc80f7f50', '6ac0a000-c0cc-41e1-a4af-bacf51932027', '3bb2f19b-989a-4603-a54f-0a56cdbb7be2'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:18 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e" returned: 0 in 0.553s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:18 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e is being set with open permissions: ugo+rw Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:18 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e Sep 28 15:13:18 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Delete snapshot completed successfully. Sep 28 15:13:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c380693f-dc2a-466e-a462-204f2874da54 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-c0083ee5-5be0-4310-81af-c7045ba88521-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:19 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e" returned: 0 in 0.370s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-79b6b505-4c50-4f46-bba8-776c8f503aef tempest-VolumesDeleteCascade-1335777124 None] Create snapshot completed successfully Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-9c300ca3-ead7-4c19-9f93-f86f9bc30051-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-9c300ca3-ead7-4c19-9f93-f86f9bc30051-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-9c300ca3-ead7-4c19-9f93-f86f9bc30051" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-9c300ca3-ead7-4c19-9f93-f86f9bc30051" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe9324-ce01-4e5f-9498-977b8bb83f43]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:19 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 Sep 28 15:13:19 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-80f62b39-cd1f-44a7-a37c-b96c52c67cc4-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-80f62b39-cd1f-44a7-a37c-b96c52c67cc4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Performing cascade delete. {{(pid=86384) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-6de413cf-0e7b-4459-a18c-43248cd6d07e-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-6de413cf-0e7b-4459-a18c-43248cd6d07e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:20 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051" returned: 0 in 0.544s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-6de413cf-0e7b-4459-a18c-43248cd6d07e" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-6de413cf-0e7b-4459-a18c-43248cd6d07e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:20 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051 Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Deleting offline snapshot 6de413cf-0e7b-4459-a18c-43248cd6d07e of volume 80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:20 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] snapshot_file for this snap is: volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[69515728-1669-4ded-89a6-28045551de3f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e Sep 28 15:13:20 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9c300ca3-ead7-4c19-9f93-f86f9bc30051" returned: 0 in 0.389s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-9c300ca3-ead7-4c19-9f93-f86f9bc30051" released by "delete_volume" :: held 1.055s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['6bdc0373-0cba-4ed0-a06a-b7e5d75662cc', '413089c9-f0fa-4e57-b189-ea33bb6cdffb', 'ac2b88de-9679-43a5-8c15-b4af584f70fa', '77dc4f1b-84a2-4bd9-898c-f4b97c03a20d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e" returned: 0 in 0.586s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:20 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:13:20 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610a7b0-179e-4249-b652-2bf340d59a10]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:21 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b Sep 28 15:13:21 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:21 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:21 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Deleted volume successfully. Sep 28 15:13:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cdfd49b1-2901-4681-b268-e29a9cf92b03 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-9c300ca3-ead7-4c19-9f93-f86f9bc30051-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:21 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b" returned: 0 in 0.517s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:21 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e Sep 28 15:13:21 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:22 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e" returned: 0 in 0.610s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:22 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e Sep 28 15:13:22 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:22 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.6de413cf-0e7b-4459-a18c-43248cd6d07e" returned: 0 in 0.464s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-6de413cf-0e7b-4459-a18c-43248cd6d07e" released by "_delete_snapshot" :: held 2.378s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" released by "delete_snapshot" :: held 2.437s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Created reservations ['8511e4bf-cbff-4f3e-bd62-eb20df2caf71', '00127e24-4770-466e-83c3-28747942f0c7', 'd2acd7dc-60fe-4960-be87-8613fa58ffac', 'c57678cd-e3f5-4953-8cd3-db7747ebf8eb'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:22 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Delete snapshot completed successfully. Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (8a317541-7a14-4efe-955a-5bdcf945f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3afec1-a08f-4438-843f-ec678dcbd487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-6de413cf-0e7b-4459-a18c-43248cd6d07e-delete_snapshot" released by "delete_snapshot" :: held 2.794s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-7f7e6f13-12a4-416b-9bbe-5d195919ae6b-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3afec1-a08f-4438-843f-ec678dcbd487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1170665599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34d70b3-6ee0-41de-957b-aa04974ad115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:23Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246625b4-b581-4c94-ba9a-c41372f121ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246625b4-b581-4c94-ba9a-c41372f121ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4636e7e7-0fce-4f24-a8d1-d98a7382473e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4636e7e7-0fce-4f24-a8d1-d98a7382473e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e34d70b3-6ee0-41de-957b-aa04974ad115', 'volume_name': 'volume-e34d70b3-6ee0-41de-957b-aa04974ad115', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e31ed9f-00f3-4766-aba0-648fc65220c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e31ed9f-00f3-4766-aba0-648fc65220c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f952298c-6f48-42e5-94ac-4a375d3b886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Volume e34d70b3-6ee0-41de-957b-aa04974ad115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e34d70b3-6ee0-41de-957b-aa04974ad115', 'volume_size': 1} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1170665599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34d70b3-6ee0-41de-957b-aa04974ad115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:23Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Creating volume e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:23 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-7f7e6f13-12a4-416b-9bbe-5d195919ae6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.123s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:23 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 1073741824 Sep 28 15:13:23 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-7f7e6f13-12a4-416b-9bbe-5d195919ae6b" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-7f7e6f13-12a4-416b-9bbe-5d195919ae6b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Deleting offline snapshot 7f7e6f13-12a4-416b-9bbe-5d195919ae6b of volume 80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] snapshot_file for this snap is: volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5f8202-9100-48f5-b032-0fd0b3b3989e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:23 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b Sep 28 15:13:23 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:23 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b" returned: 0 in 0.610s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:23 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 1073741824" returned: 0 in 0.800s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c9b6c9-b5f9-4e20-950d-54f42e0218dc]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:23 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 Sep 28 15:13:23 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:24 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 Sep 28 15:13:24 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:24 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f952298c-6f48-42e5-94ac-4a375d3b886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e34d70b3-6ee0-41de-957b-aa04974ad115', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4322e7e0-1404-4cd8-8189-9be23763963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:24 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Volume volume-e34d70b3-6ee0-41de-957b-aa04974ad115 (e34d70b3-6ee0-41de-957b-aa04974ad115): created successfully Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4322e7e0-1404-4cd8-8189-9be23763963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (8a317541-7a14-4efe-955a-5bdcf945f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ca179a39-a8b7-47c6-9add-7d2d0c146f1e tempest-VolumesSnapshotTestJSON-984781315 None] Created volume successfully. Sep 28 15:13:24 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" returned: 0 in 0.505s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:24 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b Sep 28 15:13:24 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:24 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b" returned: 0 in 0.483s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:24 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b Sep 28 15:13:24 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Creating offline snapshot 80990b1f-42de-4be3-8bc4-24a92edd5b00 of volume e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:25 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4.7f7e6f13-12a4-416b-9bbe-5d195919ae6b" returned: 0 in 0.415s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1886998e-7566-4d86-9ce0-bc2c1dab29e4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-7f7e6f13-12a4-416b-9bbe-5d195919ae6b" released by "_delete_snapshot" :: held 2.205s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" released by "delete_snapshot" :: held 2.241s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Created reservations ['513bd349-fbca-47cb-bff0-9fb49c8a8c4c', '6d319889-30ad-48e6-896b-f08d0ee67522', 'e68e3530-89f0-4562-ac7b-8f7a7503efe8', 'afc0a23a-8226-423d-a809-5f2844c21135'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:25 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 Sep 28 15:13:25 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Delete snapshot completed successfully. Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-7f7e6f13-12a4-416b-9bbe-5d195919ae6b-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Snapshots deleted, issuing volume delete {{(pid=86384) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[726301e9-ca8c-4426-9709-26279f5e1512]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:25 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 Sep 28 15:13:25 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115" returned: 0 in 0.711s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:26 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 1G Sep 28 15:13:26 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" returned: 0 in 0.694s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:26 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4 Sep 28 15:13:26 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" returned: 0 in 0.368s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-80f62b39-cd1f-44a7-a37c-b96c52c67cc4" released by "delete_volume" :: held 1.187s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:26 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 1G" returned: 0 in 0.758s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e34d70b3-6ee0-41de-957b-aa04974ad115 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:26 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e34d70b3-6ee0-41de-957b-aa04974ad115 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 Sep 28 15:13:26 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Created reservations ['b2aa0835-e22c-448f-a67a-89db0925fb77', '8f5ad502-d8f0-48f4-b0c9-bb8942b9906d', '052beaf7-bfc6-4200-984a-07e526053715', '6227e6f9-9618-4137-8bc9-297e07be5473'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:27 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:13:27 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:27 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.415s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:27 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Deleted volume successfully. Sep 28 15:13:27 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e34d70b3-6ee0-41de-957b-aa04974ad115 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00" returned: 0 in 0.643s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:27 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 is being set with open permissions: ugo+rw Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-619bb9cb-1305-40a8-8572-4f3566351658 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-80f62b39-cd1f-44a7-a37c-b96c52c67cc4-delete_volume" released by "delete_volume" :: held 7.457s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:27 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 Sep 28 15:13:27 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:27 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00" returned: 0 in 0.374s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:27 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.info Sep 28 15:13:27 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:28 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.info" returned: 0 in 0.384s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:28 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.info is being set with open permissions: ugo+rw Sep 28 15:13:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:28 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.info Sep 28 15:13:28 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:28 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.info" returned: 0 in 0.439s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.529s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:28 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-aa26bbec-8adc-4024-8b93-725bd15cf4e3 tempest-VolumesSnapshotTestJSON-984781315 None] Create snapshot completed successfully Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Flow 'volume_create_manager' (7cf1ab1f-6cab-460a-a013-7426faa6b12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145a72fc-3edb-4748-96d9-530437a97c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145a72fc-3edb-4748-96d9-530437a97c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1040566630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662754bb-4121-4307-8ec8-9af15e12144a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db921dca9b2941009d027bdd5e540331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:30Z,use_quota=True,user_id='03b242c6c894443b826b3d549238b4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19e277a-e688-4ad4-a7f5-bef4b1723037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19e277a-e688-4ad4-a7f5-bef4b1723037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47534b20-a576-4ea8-98a8-8de55fc4f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47534b20-a576-4ea8-98a8-8de55fc4f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662754bb-4121-4307-8ec8-9af15e12144a', 'volume_name': 'volume-662754bb-4121-4307-8ec8-9af15e12144a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e198b63d-11c0-4cc2-8a96-0a566141545e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e198b63d-11c0-4cc2-8a96-0a566141545e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0aad64-513a-411d-a0d6-9e20d50b46b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Volume 662754bb-4121-4307-8ec8-9af15e12144a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662754bb-4121-4307-8ec8-9af15e12144a', 'volume_size': 1} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1040566630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662754bb-4121-4307-8ec8-9af15e12144a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db921dca9b2941009d027bdd5e540331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:30Z,use_quota=True,user_id='03b242c6c894443b826b3d549238b4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Creating volume 662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:29 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:13:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:29 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a 1073741824 Sep 28 15:13:29 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:30 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a 1073741824" returned: 0 in 0.643s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (26526e87-095c-46fc-af92-37e36cce1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f30d9-3b3a-490b-902d-a3f6c3b3ea5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f30d9-3b3a-490b-902d-a3f6c3b3ea5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1656360479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c416256-c85c-4992-8c06-5a44f0e7f0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615f3e050f7d4335930df1f134bc9461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80990b1f-42de-4be3-8bc4-24a92edd5b00,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:30Z,use_quota=True,user_id='2733c08446a04427b7568a6590ad5520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9235ce-b42c-4f91-97af-a3b0e46d758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9235ce-b42c-4f91-97af-a3b0e46d758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34316513-e5f6-4fd7-b920-41438bd50b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34316513-e5f6-4fd7-b920-41438bd50b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c416256-c85c-4992-8c06-5a44f0e7f0ee', 'volume_name': 'volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee', 'volume_size': 1, 'snapshot_id': '80990b1f-42de-4be3-8bc4-24a92edd5b00'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc8ed89-bc2d-49e9-98b6-76510e5e8728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc8ed89-bc2d-49e9-98b6-76510e5e8728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c543b79-e72b-4fd6-8c43-ca60f09da7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:30 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Volume 4c416256-c85c-4992-8c06-5a44f0e7f0ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee', 'volume_size': 1, 'snapshot_id': '80990b1f-42de-4be3-8bc4-24a92edd5b00'} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:30 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a Sep 28 15:13:30 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:30 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a" returned: 0 in 0.367s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:13:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.393s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-80990b1f-42de-4be3-8bc4-24a92edd5b00-4c416256-c85c-4992-8c06-5a44f0e7f0ee" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0aad64-513a-411d-a0d6-9e20d50b46b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662754bb-4121-4307-8ec8-9af15e12144a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debece38-2038-4f2c-a713-1a24ee4ed2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-80990b1f-42de-4be3-8bc4-24a92edd5b00-4c416256-c85c-4992-8c06-5a44f0e7f0ee" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Creating volume 4c416256-c85c-4992-8c06-5a44f0e7f0ee from snapshot 80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-4c416256-c85c-4992-8c06-5a44f0e7f0ee" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:31 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Volume volume-662754bb-4121-4307-8ec8-9af15e12144a (662754bb-4121-4307-8ec8-9af15e12144a): created successfully Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debece38-2038-4f2c-a713-1a24ee4ed2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Flow 'volume_create_manager' (7cf1ab1f-6cab-460a-a013-7426faa6b12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-4c416256-c85c-4992-8c06-5a44f0e7f0ee" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] snapshot: 80990b1f-42de-4be3-8bc4-24a92edd5b00, volume: 4c416256-c85c-4992-8c06-5a44f0e7f0ee, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:13:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9b104994-7e27-4b1d-90b9-9853269d384c tempest-VolumesDeleteCascade-1335777124 None] Created volume successfully. Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9af9e06-9e19-446d-8775-94b5e94a89d2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:31 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 Sep 28 15:13:31 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:31 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00" returned: 0 in 0.633s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e34d70b3-6ee0-41de-957b-aa04974ad115(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b620b2d-1608-403c-80af-fbed464521a8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:32 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 Sep 28 15:13:32 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:32 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115" returned: 0 in 0.477s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:13:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:13:32 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:13:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:32 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee Sep 28 15:13:32 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:33 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:13:33 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:34 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 1.110s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:13:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=55,cinder:SELECT=53,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=43,cinder:INSERT=14,cinder:UPDATE=52,cinder:DELETE=7 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:42 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee" returned: 0 in 9.967s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115, size 1024.00 MB, duration 9.97 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:13:42 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Converted 1024.00 MB image at 102.72 MB/s Sep 28 15:13:42 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee is being set with open permissions: ugo+rw Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:42 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee Sep 28 15:13:42 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:42 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee" returned: 0 in 0.355s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-4c416256-c85c-4992-8c06-5a44f0e7f0ee" released by "_copy_volume_from_snapshot" :: held 11.605s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-80990b1f-42de-4be3-8bc4-24a92edd5b00-4c416256-c85c-4992-8c06-5a44f0e7f0ee" released by "_create_volume_from_snapshot" :: held 11.719s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.771s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.655s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Creating offline snapshot 00b03b80-1d5f-4671-971a-248fd3f861ea of volume 662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c543b79-e72b-4fd6-8c43-ca60f09da7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee', 'volume_size': 1, 'snapshot_id': '80990b1f-42de-4be3-8bc4-24a92edd5b00'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abca4ea6-3832-436d-8371-fe43d1f8addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2603e95-4309-463a-978f-60b8395a3abf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Volume volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee (4c416256-c85c-4992-8c06-5a44f0e7f0ee): created successfully Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abca4ea6-3832-436d-8371-fe43d1f8addf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Flow 'volume_create_manager' (26526e87-095c-46fc-af92-37e36cce1e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-640d3c15-e887-4f56-8456-91b682889bda tempest-VolumesSnapshotTestJSON-984781315 None] Created volume successfully. Sep 28 15:13:43 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a Sep 28 15:13:43 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-4c416256-c85c-4992-8c06-5a44f0e7f0ee-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-4c416256-c85c-4992-8c06-5a44f0e7f0ee-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-4c416256-c85c-4992-8c06-5a44f0e7f0ee" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:43 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a" returned: 0 in 0.756s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:43 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea 1G Sep 28 15:13:43 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-4c416256-c85c-4992-8c06-5a44f0e7f0ee" acquired by "delete_volume" :: waited 0.078s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088f853-a33b-4d91-9e1d-99f28793767e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:44 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee Sep 28 15:13:44 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:44 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea 1G" returned: 0 in 0.911s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662754bb-4121-4307-8ec8-9af15e12144a -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:44 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662754bb-4121-4307-8ec8-9af15e12144a -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea Sep 28 15:13:44 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:44 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee" returned: 0 in 0.963s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:44 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee Sep 28 15:13:44 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:44 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662754bb-4121-4307-8ec8-9af15e12144a -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea" returned: 0 in 0.442s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:44 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea is being set with open permissions: ugo+rw Sep 28 15:13:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:45 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea Sep 28 15:13:45 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:45 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4c416256-c85c-4992-8c06-5a44f0e7f0ee" returned: 0 in 0.464s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-4c416256-c85c-4992-8c06-5a44f0e7f0ee" released by "delete_volume" :: held 1.550s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['aa12fee5-42eb-4882-b30a-329a096c0c8d', 'd853060f-a201-44e6-95d1-4bea59732249', 'bed2fa07-0e56-4c27-ae61-2d0d9f04b6d0', 'b9b8ab82-d32f-4965-9b1a-03c4d60e4741'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:45 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea" returned: 0 in 0.493s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:45 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:13:45 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:45 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.info Sep 28 15:13:45 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:45 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.379s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Deleted volume successfully. Sep 28 15:13:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-73c252fa-8bbc-4f99-811a-7eb51d475c52 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-4c416256-c85c-4992-8c06-5a44f0e7f0ee-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:46 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.info" returned: 0 in 0.467s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:46 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.info is being set with open permissions: ugo+rw Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:46 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.info Sep 28 15:13:46 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-80990b1f-42de-4be3-8bc4-24a92edd5b00-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-80990b1f-42de-4be3-8bc4-24a92edd5b00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-e34d70b3-6ee0-41de-957b-aa04974ad115" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e34d70b3-6ee0-41de-957b-aa04974ad115" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-80990b1f-42de-4be3-8bc4-24a92edd5b00" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-80990b1f-42de-4be3-8bc4-24a92edd5b00" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Deleting offline snapshot 80990b1f-42de-4be3-8bc4-24a92edd5b00 of volume e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] snapshot_file for this snap is: volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb615e-a903-445e-bed6-94742b038738]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:46 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.info" returned: 0 in 0.440s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.703s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:46 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 Sep 28 15:13:46 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:46 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b1a8b993-ea32-47ec-b890-06f856ef2696 tempest-VolumesDeleteCascade-1335777124 None] Create snapshot completed successfully Sep 28 15:13:46 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00" returned: 0 in 0.507s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e34d70b3-6ee0-41de-957b-aa04974ad115(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f4e406-ab00-4d2c-83dc-43d6ca1da74b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:47 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 Sep 28 15:13:47 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:47 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115" returned: 0 in 0.832s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:47 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 Sep 28 15:13:47 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:48 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Flow 'volume_create_manager' (6da5c0c2-a730-4a52-b45a-177529c93c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5af9d4-f4e1-4a13-b95e-910d57a074d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00" returned: 0 in 0.754s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5af9d4-f4e1-4a13-b95e-910d57a074d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1185134420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47321d47-9e97-4d8a-bd97-f8f91a98446c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db921dca9b2941009d027bdd5e540331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=00b03b80-1d5f-4671-971a-248fd3f861ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:48Z,use_quota=True,user_id='03b242c6c894443b826b3d549238b4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:48 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00 Sep 28 15:13:48 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9ef19b-7157-4000-9819-368cce0e0506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9ef19b-7157-4000-9819-368cce0e0506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8e8e22-e828-4f66-bc47-5c391ef4d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8e8e22-e828-4f66-bc47-5c391ef4d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47321d47-9e97-4d8a-bd97-f8f91a98446c', 'volume_name': 'volume-47321d47-9e97-4d8a-bd97-f8f91a98446c', 'volume_size': 1, 'snapshot_id': '00b03b80-1d5f-4671-971a-248fd3f861ea'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80f4f26-9f6b-47bf-808f-05141a87478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80f4f26-9f6b-47bf-808f-05141a87478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957eb64a-546c-42a6-9870-2082c1acd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:48 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Volume 47321d47-9e97-4d8a-bd97-f8f91a98446c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47321d47-9e97-4d8a-bd97-f8f91a98446c', 'volume_size': 1, 'snapshot_id': '00b03b80-1d5f-4671-971a-248fd3f861ea'} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-00b03b80-1d5f-4671-971a-248fd3f861ea-47321d47-9e97-4d8a-bd97-f8f91a98446c" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-00b03b80-1d5f-4671-971a-248fd3f861ea-47321d47-9e97-4d8a-bd97-f8f91a98446c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Creating volume 47321d47-9e97-4d8a-bd97-f8f91a98446c from snapshot 00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-47321d47-9e97-4d8a-bd97-f8f91a98446c" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-47321d47-9e97-4d8a-bd97-f8f91a98446c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] snapshot: 00b03b80-1d5f-4671-971a-248fd3f861ea, volume: 47321d47-9e97-4d8a-bd97-f8f91a98446c, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5a6dae-330e-4199-8f39-45ae43c2eaaf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:48 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115.80990b1f-42de-4be3-8bc4-24a92edd5b00" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:48 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea Sep 28 15:13:48 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-80990b1f-42de-4be3-8bc4-24a92edd5b00" released by "_delete_snapshot" :: held 2.661s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e34d70b3-6ee0-41de-957b-aa04974ad115" released by "delete_snapshot" :: held 2.713s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['d6b77105-caad-4a66-8090-34cd165269bf', '6f97a00f-04ad-4739-8ce7-f05d1b512bdc', '1a750df8-10f5-4766-ae07-28121a76693c', '2e6e2526-93ae-4d18-9a48-f40f93bb7190'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Delete snapshot completed successfully. Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-11625719-e566-47d4-afcf-f0d9735c1bd3 tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-80990b1f-42de-4be3-8bc4-24a92edd5b00-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:49 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea" returned: 0 in 0.600s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662754bb-4121-4307-8ec8-9af15e12144a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[392b7c0e-0aa0-4e8a-af81-4daff2909a0f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:49 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a Sep 28 15:13:49 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-e34d70b3-6ee0-41de-957b-aa04974ad115-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-e34d70b3-6ee0-41de-957b-aa04974ad115-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-e34d70b3-6ee0-41de-957b-aa04974ad115" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e34d70b3-6ee0-41de-957b-aa04974ad115" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca2ccb-9791-4f5e-9ec8-625f1fa36302]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:49 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a" returned: 0 in 0.564s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:13:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:49 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c Sep 28 15:13:49 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:50 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 Sep 28 15:13:50 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:50 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115" returned: 0 in 0.478s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:50 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115 Sep 28 15:13:50 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:50 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e34d70b3-6ee0-41de-957b-aa04974ad115" returned: 0 in 0.541s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-e34d70b3-6ee0-41de-957b-aa04974ad115" released by "delete_volume" :: held 1.136s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['38636e97-edbb-48b3-8b66-7fb3c3a831fb', '34ae67a2-b4b9-46b2-b096-bbce077c7f84', '619dd523-1165-4322-a5a7-fd118882cd2b', 'b3f3b8da-c33f-49fe-8c24-279463a9a15d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:51 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:13:51 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:51 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.775s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:51 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Deleted volume successfully. Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Flow 'volume_create_manager' (42d6b7e4-7378-4152-8211-744ee6f956ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d99c7e7-6de4-4916-9b10-1c142cde22f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7651f7fa-b2ab-498b-a0ba-778a5dcaac0a tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-e34d70b3-6ee0-41de-957b-aa04974ad115-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d99c7e7-6de4-4916-9b10-1c142cde22f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1760155874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf2894f-0559-4281-bb26-2f1f333f3434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2ff53823cb4b81af6b9ec31a2858a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:52Z,use_quota=True,user_id='e45606cf8459422c89e504a32e3cdaff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb25b992-9c7b-4dd5-90f4-65eef6ebad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb25b992-9c7b-4dd5-90f4-65eef6ebad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aeb56a-16bb-4444-9399-27f5d76680b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-be111011-785f-43ac-a6c2-57dcc3218eb7-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-be111011-785f-43ac-a6c2-57dcc3218eb7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "cinder-quobyte-be111011-785f-43ac-a6c2-57dcc3218eb7" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-be111011-785f-43ac-a6c2-57dcc3218eb7" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf2e4a9-7e81-4fa8-a2c1-b64db5863f0e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aeb56a-16bb-4444-9399-27f5d76680b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cf2894f-0559-4281-bb26-2f1f333f3434', 'volume_name': 'volume-0cf2894f-0559-4281-bb26-2f1f333f3434', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f663b23-6d22-4257-b331-d9fadf7d82a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:52 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 Sep 28 15:13:52 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f663b23-6d22-4257-b331-d9fadf7d82a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac69fd82-4a78-4bc3-91bb-0329449151f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:53 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Volume 0cf2894f-0559-4281-bb26-2f1f333f3434: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cf2894f-0559-4281-bb26-2f1f333f3434', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:13:53 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Trying to clone 0cf2894f-0559-4281-bb26-2f1f333f3434 from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd at location (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:13:53 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7" returned: 0 in 0.998s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:53 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7 Sep 28 15:13:53 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:53 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:13:53 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:13:53 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ec3728-699f-430d-97a1-955fbc554746]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:54 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD Sep 28 15:13:54 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:54 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-be111011-785f-43ac-a6c2-57dcc3218eb7" returned: 0 in 0.828s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-quobyte-be111011-785f-43ac-a6c2-57dcc3218eb7" released by "delete_volume" :: held 2.013s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:54 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:54 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd is fetched for user e45606cf8459422c89e504a32e3cdaff. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:13:54 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Created reservations ['f2661cdb-8b9e-4e4f-a9e1-b33e3b754a77', 'b3db9d59-6c82-459f-b3db-4c20de7a6993', '54d945a7-bbd5-47cf-a1fe-14776cdbeb1b', '9a85d233-472c-45e0-864c-c611c4f27048'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379edd9-006c-4cef-a224-60f62e29ca3d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:55 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:13:55 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:55 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD Sep 28 15:13:55 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:55 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.469s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Deleted volume successfully. Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dc62dd93-7d56-4b78-9a7e-67b4e61452dc tempest-VolumesSnapshotTestJSON-984781315 None] Lock "cinder-be111011-785f-43ac-a6c2-57dcc3218eb7-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:55 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Flow 'volume_create_manager' (b8fdf71a-0605-4a4c-a4eb-10b0f7eaf5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4ea214-acee-466a-a11e-3ca3460d396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4ea214-acee-466a-a11e-3ca3460d396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1349802688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78aeeea4-cd7f-45e4-8617-d0aca3856bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac59a804f7b4afb9350b5ab12a2a9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:56Z,use_quota=True,user_id='631899c2eb67496695e7c17484abc339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5e0d200-dd77-4a4b-bcf8-49a8aea8f518),volume_type_id=b5e0d200-dd77-4a4b-bcf8-49a8aea8f518)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd4cb58-2bac-4b00-a618-3d9ab6299045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd4cb58-2bac-4b00-a618-3d9ab6299045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e90a73e-83e5-4c51-b39c-6a6edce8fa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e90a73e-83e5-4c51-b39c-6a6edce8fa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78aeeea4-cd7f-45e4-8617-d0aca3856bf1', 'volume_name': 'volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eea1dc-fe36-437c-be5e-ea2cb3ba851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eea1dc-fe36-437c-be5e-ea2cb3ba851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad5041-f51f-4438-9ca0-5931b01f881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:56 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume 78aeeea4-cd7f-45e4-8617-d0aca3856bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1', 'volume_size': 1} Sep 28 15:13:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Flow 'volume_create_manager' (ef01b4cb-99a1-4776-a5e0-548c3aa7f376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e6be7-efcc-474e-8c65-2033e804c4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e6be7-efcc-474e-8c65-2033e804c4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-31932968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908cfcea-aeea-4878-a88e-fbde42d6f5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac59a804f7b4afb9350b5ab12a2a9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:57Z,use_quota=True,user_id='631899c2eb67496695e7c17484abc339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36bb3b44-ad32-47da-9633-262ffad8c366),volume_type_id=36bb3b44-ad32-47da-9633-262ffad8c366)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573aef8e-44c3-4764-bc5f-019b414fff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573aef8e-44c3-4764-bc5f-019b414fff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e2ef3b-edca-4d16-830d-f0b3c90118ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e2ef3b-edca-4d16-830d-f0b3c90118ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908cfcea-aeea-4878-a88e-fbde42d6f5c4', 'volume_name': 'volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b4d95e-e213-4820-968d-f2fb783a241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b4d95e-e213-4820-968d-f2fb783a241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0ed68f-9d63-4246-aaba-f1b298fbfccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume 908cfcea-aeea-4878-a88e-fbde42d6f5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4', 'volume_size': 1} Sep 28 15:13:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Flow 'volume_create_manager' (f4f2d9d3-c65e-4e3a-a79d-533e5e887147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ad1593-b344-40c4-b9c7-4e42d33f6203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ad1593-b344-40c4-b9c7-4e42d33f6203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1566658808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc9b104-154f-4db2-b2d8-999d09be7eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac59a804f7b4afb9350b5ab12a2a9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:58Z,use_quota=True,user_id='631899c2eb67496695e7c17484abc339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83b2f227-152a-4534-9b7c-3ab0cdc356c2),volume_type_id=83b2f227-152a-4534-9b7c-3ab0cdc356c2)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fefe8b-3b06-4e20-89ea-1d29d63a8364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fefe8b-3b06-4e20-89ea-1d29d63a8364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419cef39-9e2b-4a6e-9741-920ead5feda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:58 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419cef39-9e2b-4a6e-9741-920ead5feda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bc9b104-154f-4db2-b2d8-999d09be7eeb', 'volume_name': 'volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb', 'volume_size': 1, 'image_id': 'bd093a32-4f6a-429e-8a24-33792f871ad9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd093a32-4f6a-429e-8a24-33792f871ad9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2013829549', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dac59a804f7b4afb9350b5ab12a2a9d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd093a32-4f6a-429e-8a24-33792f871ad9', 'created_at': datetime.datetime(2026, 9, 28, 13, 13, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd093a32-4f6a-429e-8a24-33792f871ad9/file', 'properties': {}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88caa947-10c3-49dd-8094-a7ef7199d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88caa947-10c3-49dd-8094-a7ef7199d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35eb7937-de07-4737-91aa-b1e90d713ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume 6bc9b104-154f-4db2-b2d8-999d09be7eeb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb', 'volume_size': 1, 'image_id': 'bd093a32-4f6a-429e-8a24-33792f871ad9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd093a32-4f6a-429e-8a24-33792f871ad9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2013829549', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dac59a804f7b4afb9350b5ab12a2a9d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd093a32-4f6a-429e-8a24-33792f871ad9', 'created_at': datetime.datetime(2026, 9, 28, 13, 13, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd093a32-4f6a-429e-8a24-33792f871ad9/file', 'properties': {}}, 'image_service': } Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Trying to clone 6bc9b104-154f-4db2-b2d8-999d09be7eeb from image bd093a32-4f6a-429e-8a24-33792f871ad9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd093a32-4f6a-429e-8a24-33792f871ad9', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:13:59 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c" returned: 0 in 9.833s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a, size 1024.00 MB, duration 9.83 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:13:59 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Converted 1024.00 MB image at 104.12 MB/s Sep 28 15:13:59 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c is being set with open permissions: ugo+rw Sep 28 15:13:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:59 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c Sep 28 15:13:59 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:00 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c" returned: 0 in 0.272s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-47321d47-9e97-4d8a-bd97-f8f91a98446c" released by "_copy_volume_from_snapshot" :: held 11.397s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-00b03b80-1d5f-4671-971a-248fd3f861ea-47321d47-9e97-4d8a-bd97-f8f91a98446c" released by "_create_volume_from_snapshot" :: held 11.494s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.514s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.406s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1760155874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf2894f-0559-4281-bb26-2f1f333f3434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2ff53823cb4b81af6b9ec31a2858a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:52Z,use_quota=True,user_id='e45606cf8459422c89e504a32e3cdaff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Creating volume 0cf2894f-0559-4281-bb26-2f1f333f3434 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:00 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:00 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 1073741824 Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957eb64a-546c-42a6-9870-2082c1acd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47321d47-9e97-4d8a-bd97-f8f91a98446c', 'volume_size': 1, 'snapshot_id': '00b03b80-1d5f-4671-971a-248fd3f861ea'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b94757-6702-4dae-894e-1c08de568647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:00 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:00 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Volume volume-47321d47-9e97-4d8a-bd97-f8f91a98446c (47321d47-9e97-4d8a-bd97-f8f91a98446c): created successfully Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b94757-6702-4dae-894e-1c08de568647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Flow 'volume_create_manager' (6da5c0c2-a730-4a52-b45a-177529c93c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1462f61a-69ec-4fed-b514-58189cb0f097 tempest-VolumesDeleteCascade-1335777124 None] Created volume successfully. Sep 28 15:14:00 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 1073741824" returned: 0 in 0.598s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:00 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 Sep 28 15:14:00 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434" returned: 0 in 0.293s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.806s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1349802688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78aeeea4-cd7f-45e4-8617-d0aca3856bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac59a804f7b4afb9350b5ab12a2a9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:56Z,use_quota=True,user_id='631899c2eb67496695e7c17484abc339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5e0d200-dd77-4a4b-bcf8-49a8aea8f518),volume_type_id=b5e0d200-dd77-4a4b-bcf8-49a8aea8f518)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Creating volume 78aeeea4-cd7f-45e4-8617-d0aca3856bf1 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:01 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 1073741824 Sep 28 15:14:01 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Attempting download of 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume 0cf2894f-0559-4281-bb26-2f1f333f3434. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c49eb4d-a182-4eab-ab19-456a23d42a1d]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_gg2wz95r {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:01 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_gg2wz95r Sep 28 15:14:01 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-662754bb-4121-4307-8ec8-9af15e12144a-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-662754bb-4121-4307-8ec8-9af15e12144a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Performing cascade delete. {{(pid=86384) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-00b03b80-1d5f-4671-971a-248fd3f861ea-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:01 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_gg2wz95r" returned: 0 in 0.378s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_gg2wz95r {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-00b03b80-1d5f-4671-971a-248fd3f861ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-662754bb-4121-4307-8ec8-9af15e12144a" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-662754bb-4121-4307-8ec8-9af15e12144a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-00b03b80-1d5f-4671-971a-248fd3f861ea" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-00b03b80-1d5f-4671-971a-248fd3f861ea" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Deleting offline snapshot 00b03b80-1d5f-4671-971a-248fd3f861ea of volume 662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] snapshot_file for this snap is: volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3da2454-9b2a-40cb-a7c7-8a0d5fd47c8a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:01 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_gg2wz95r Sep 28 15:14:01 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 1073741824" returned: 0 in 0.678s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea Sep 28 15:14:01 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:01 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 Sep 28 15:14:01 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_gg2wz95r" returned: 1 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_gg2wz95r' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170f4d1-6743-427d-ab7b-4ae9a0ef1b21]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:02 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:02 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD Sep 28 15:14:02 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea" returned: 0 in 0.594s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662754bb-4121-4307-8ec8-9af15e12144a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:02 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1" returned: 0 in 0.500s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.974s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-31932968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908cfcea-aeea-4878-a88e-fbde42d6f5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac59a804f7b4afb9350b5ab12a2a9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:57Z,use_quota=True,user_id='631899c2eb67496695e7c17484abc339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36bb3b44-ad32-47da-9633-262ffad8c366),volume_type_id=36bb3b44-ad32-47da-9633-262ffad8c366)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Creating volume 908cfcea-aeea-4878-a88e-fbde42d6f5c4 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:02 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d644220b-5bc0-4ff9-9bfa-e66a59082dc2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:02 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 1073741824 Sep 28 15:14:02 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad5041-f51f-4438-9ca0-5931b01f881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9571a32f-ce48-4128-8fa3-8d09a8940c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 (78aeeea4-cd7f-45e4-8617-d0aca3856bf1): created successfully Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9571a32f-ce48-4128-8fa3-8d09a8940c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Flow 'volume_create_manager' (b8fdf71a-0605-4a4c-a4eb-10b0f7eaf5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a4e01cae-e162-40c4-b361-30195b863d66 tempest-TestInstancesWithCinderVolumes-18731654 None] Created volume successfully. Sep 28 15:14:02 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a Sep 28 15:14:02 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:02 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd was qcow2, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:14:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:02 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 Sep 28 15:14:02 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:03 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 1073741824" returned: 0 in 0.765s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:03 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a" returned: 0 in 0.792s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:03 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea Sep 28 15:14:03 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:03 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 Sep 28 15:14:03 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:03 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4" returned: 0 in 0.433s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0ed68f-9d63-4246-aaba-f1b298fbfccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f3c493-2c77-4cb5-bb12-2b05e9c4ec18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 (908cfcea-aeea-4878-a88e-fbde42d6f5c4): created successfully Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f3c493-2c77-4cb5-bb12-2b05e9c4ec18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Flow 'volume_create_manager' (ef01b4cb-99a1-4776-a5e0-548c3aa7f376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:03 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a4aea053-05bd-432c-90bd-47454ebaad08 tempest-TestInstancesWithCinderVolumes-18731654 None] Created volume successfully. Sep 28 15:14:03 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea" returned: 0 in 0.601s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:03 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea Sep 28 15:14:03 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:04 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a.00b03b80-1d5f-4671-971a-248fd3f861ea" returned: 0 in 0.340s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-00b03b80-1d5f-4671-971a-248fd3f861ea" released by "_delete_snapshot" :: held 2.485s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-662754bb-4121-4307-8ec8-9af15e12144a" released by "delete_snapshot" :: held 2.521s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Created reservations ['30b12a82-8cfd-4d4a-9fb5-1da9a18fa6f4', '055ef4f0-09d4-4d52-b19a-cdf6f35ed734', 'ed8adfdd-7837-403d-aac1-e345bf396bf4', 'a9d8c3c5-f717-4b53-b542-1e5efb757146'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Delete snapshot completed successfully. Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-00b03b80-1d5f-4671-971a-248fd3f861ea-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Snapshots deleted, issuing volume delete {{(pid=86384) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-662754bb-4121-4307-8ec8-9af15e12144a" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-662754bb-4121-4307-8ec8-9af15e12144a" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[068033bc-4adc-42c8-a50b-4459299df1dc]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:04 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a Sep 28 15:14:04 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD, size 20.69 MB, duration 5.55 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:14:05 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Image download 20.69 MB at 3.73 MB/s Sep 28 15:14:05 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6275c7d1-30fc-4825-815a-40f85bef90b3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a" returned: 0 in 0.665s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a Sep 28 15:14:05 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD Sep 28 15:14:05 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Temporary image bd093a32-4f6a-429e-8a24-33792f871ad9 is fetched for user 631899c2eb67496695e7c17484abc339. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:14:05 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-662754bb-4121-4307-8ec8-9af15e12144a" returned: 0 in 0.429s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:05 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434" returned: 0 in 3.026s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_q6_kvjnadevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:14:05 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Converted 112.00 MB image at 36.99 MB/s Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-662754bb-4121-4307-8ec8-9af15e12144a" released by "delete_volume" :: held 1.242s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:05 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 1G Sep 28 15:14:05 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e613ea4a-9614-47c7-b6d6-716bfdf6cc0c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Created reservations ['f1083b9a-2622-406b-b069-f531def91b6e', 'f11dc7e1-05fd-4c94-9445-49f091ffa2dd', 'bb3f39d0-a393-4c63-a4c1-f2daf311deb4', 'be7c5cf2-20ca-4a0f-a32e-2370f4dffc9d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD Sep 28 15:14:05 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:14:05 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-47321d47-9e97-4d8a-bd97-f8f91a98446c-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:06 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 1G" returned: 0 in 0.577s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Downloaded image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume 0cf2894f-0559-4281-bb26-2f1f333f3434 successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd for user e45606cf8459422c89e504a32e3cdaff is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Marking volume 0cf2894f-0559-4281-bb26-2f1f333f3434 as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-47321d47-9e97-4d8a-bd97-f8f91a98446c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Copying metadata from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd to 0cf2894f-0559-4281-bb26-2f1f333f3434. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Creating volume glance metadata for volume 0cf2894f-0559-4281-bb26-2f1f333f3434 backed by image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "cinder-quobyte-47321d47-9e97-4d8a-bd97-f8f91a98446c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:06 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.484s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-47321d47-9e97-4d8a-bd97-f8f91a98446c" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:06 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Deleted volume successfully. Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD" returned: 0 in 0.678s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1566658808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc9b104-154f-4db2-b2d8-999d09be7eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac59a804f7b4afb9350b5ab12a2a9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:58Z,use_quota=True,user_id='631899c2eb67496695e7c17484abc339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83b2f227-152a-4534-9b7c-3ab0cdc356c2),volume_type_id=83b2f227-152a-4534-9b7c-3ab0cdc356c2)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Creating volume 6bc9b104-154f-4db2-b2d8-999d09be7eeb {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:06 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7381f8-eeb6-4333-bb04-e50eb7faa1a4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb 1073741824 Sep 28 15:14:06 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-79b3f0ce-44b5-440d-9643-94dc459a8c1b tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-662754bb-4121-4307-8ec8-9af15e12144a-delete_volume" released by "delete_volume" :: held 4.982s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac69fd82-4a78-4bc3-91bb-0329449151f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf2894f-0559-4281-bb26-2f1f333f3434', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2757a-3b4f-4f59-8931-10fd6f1e0789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Volume volume-0cf2894f-0559-4281-bb26-2f1f333f3434 (0cf2894f-0559-4281-bb26-2f1f333f3434): created successfully Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2757a-3b4f-4f59-8931-10fd6f1e0789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Flow 'volume_create_manager' (42d6b7e4-7378-4152-8211-744ee6f956ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-02971dd0-aeb3-47d7-8f3f-6b10a9a5ab8d tempest-TestShelveInstance-812357556 None] Created volume successfully. Sep 28 15:14:06 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c Sep 28 15:14:06 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c" returned: 0 in 0.572s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c Sep 28 15:14:06 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb 1073741824" returned: 0 in 0.625s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:07 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb Sep 28 15:14:07 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:07 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb" returned: 0 in 0.303s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:07 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Attempting download of bd093a32-4f6a-429e-8a24-33792f871ad9 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd093a32-4f6a-429e-8a24-33792f871ad9', 'metadata': {}}])) to volume 6bc9b104-154f-4db2-b2d8-999d09be7eeb. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-47321d47-9e97-4d8a-bd97-f8f91a98446c" returned: 0 in 0.429s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-quobyte-47321d47-9e97-4d8a-bd97-f8f91a98446c" released by "delete_volume" :: held 1.085s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097bf0d-1ae6-49dd-a5f0-017de3b6eb6a]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd093a32-4f6a-429e-8a24-33792f871ad9_c3det_7b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Created reservations ['28fef464-e380-4e14-b078-f46c37064308', '99a5788d-4a1a-4ec4-8af8-a55a51713ac4', '5b87e93b-fa01-43e0-b2d2-9fc18d150d09', 'a00b83f9-4026-43dc-b9a3-245debc151e4'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:07 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd093a32-4f6a-429e-8a24-33792f871ad9_c3det_7b Sep 28 15:14:07 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:07 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:14:07 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:07 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd093a32-4f6a-429e-8a24-33792f871ad9_c3det_7b" returned: 0 in 0.500s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd093a32-4f6a-429e-8a24-33792f871ad9_c3det_7b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:08 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.417s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:08 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd093a32-4f6a-429e-8a24-33792f871ad9_c3det_7b Sep 28 15:14:08 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Deleted volume successfully. Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-92657200-3514-4afc-9f34-6740c085596e tempest-VolumesDeleteCascade-1335777124 None] Lock "cinder-47321d47-9e97-4d8a-bd97-f8f91a98446c-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:08 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd093a32-4f6a-429e-8a24-33792f871ad9_c3det_7b" returned: 1 in 0.517s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd093a32-4f6a-429e-8a24-33792f871ad9_c3det_7b' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c07dc32-89b3-46c1-a28a-106488ac1dfb]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:08 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD Sep 28 15:14:08 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:08 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] bd093a32-4f6a-429e-8a24-33792f871ad9 was qcow2, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:14:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:09 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb Sep 28 15:14:09 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Flow 'volume_create_manager' (9feacd4e-7081-49a4-ad46-9656b10fe630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92251bb-0faf-412d-bb54-2bd466dbea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92251bb-0faf-412d-bb54-2bd466dbea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1539442240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a100bbaf55a34b4e9447ea8b8723ff9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:09Z,use_quota=True,user_id='38d1f537ed664847ac3f269aa890774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1a55cb-fa4f-476f-8888-3a20680363d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1a55cb-fa4f-476f-8888-3a20680363d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94183324-9629-4555-b5b9-cbf50b3da46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94183324-9629-4555-b5b9-cbf50b3da46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1', 'volume_name': 'volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1', 'volume_size': 2}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9457bc-3159-46e1-9eb1-5ed100184efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9457bc-3159-46e1-9eb1-5ed100184efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc0872-f4a8-433d-a5e1-6d687cfc8031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Volume 27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1', 'volume_size': 2} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1539442240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a100bbaf55a34b4e9447ea8b8723ff9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:09Z,use_quota=True,user_id='38d1f537ed664847ac3f269aa890774d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Creating volume 27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:09 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:14:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 2147483648 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:09 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 2147483648 Sep 28 15:14:09 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:10 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 2147483648" returned: 0 in 0.706s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:10 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 Sep 28 15:14:10 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:10 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" returned: 0 in 0.416s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc0872-f4a8-433d-a5e1-6d687cfc8031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1', 'volume_size': 2}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd17f73c-9f43-4be8-96ca-b4cfab68dc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Volume volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 (27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1): created successfully Sep 28 15:14:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd17f73c-9f43-4be8-96ca-b4cfab68dc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Flow 'volume_create_manager' (9feacd4e-7081-49a4-ad46-9656b10fe630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-51af6519-a49b-48b3-afed-8c1c986be407 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Created volume successfully. Sep 28 15:14:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-18b5620e-6d63-45fe-bfb2-1b555ab7a8c2 req-dfe720fa-ce1d-4b24-a3f2-109384c79d96 tempest-TestShelveInstance-812357556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-18b5620e-6d63-45fe-bfb2-1b555ab7a8c2 req-dfe720fa-ce1d-4b24-a3f2-109384c79d96 tempest-TestShelveInstance-812357556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-18b5620e-6d63-45fe-bfb2-1b555ab7a8c2 req-dfe720fa-ce1d-4b24-a3f2-109384c79d96 tempest-TestShelveInstance-812357556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-18b5620e-6d63-45fe-bfb2-1b555ab7a8c2 req-dfe720fa-ce1d-4b24-a3f2-109384c79d96 tempest-TestShelveInstance-812357556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-0cf2894f-0559-4281-bb26-2f1f333f3434', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf017cbb-edc1-45ce-ba89-2a3ba67e2683', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-18b5620e-6d63-45fe-bfb2-1b555ab7a8c2 req-dfe720fa-ce1d-4b24-a3f2-109384c79d96 tempest-TestShelveInstance-812357556 None] attachment_update completed successfully. Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Creating offline snapshot cad66a8a-271d-4621-872b-05dc06a95088 of volume 27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e783bd99-1078-4162-a8de-5de6e71df995]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb" returned: 0 in 3.232s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd093a32-4f6a-429e-8a24-33792f871ad9_l6ehp8a1devstack@QuobyteHD, size 112.00 MB, duration 3.23 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:14:12 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Converted 112.00 MB image at 34.63 MB/s Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb 1G Sep 28 15:14:12 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:12 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 Sep 28 15:14:12 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:12 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" returned: 0 in 0.631s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 2G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb 1G" returned: 0 in 0.597s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Downloaded image bd093a32-4f6a-429e-8a24-33792f871ad9 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd093a32-4f6a-429e-8a24-33792f871ad9', 'metadata': {}}])) to volume 6bc9b104-154f-4db2-b2d8-999d09be7eeb successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Temporary image bd093a32-4f6a-429e-8a24-33792f871ad9 for user 631899c2eb67496695e7c17484abc339 is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Marking volume 6bc9b104-154f-4db2-b2d8-999d09be7eeb as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Copying metadata from image bd093a32-4f6a-429e-8a24-33792f871ad9 to 6bc9b104-154f-4db2-b2d8-999d09be7eeb. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Creating volume glance metadata for volume 6bc9b104-154f-4db2-b2d8-999d09be7eeb backed by image bd093a32-4f6a-429e-8a24-33792f871ad9 with: {'image_id': 'bd093a32-4f6a-429e-8a24-33792f871ad9', 'image_name': 'tempest-scenario-img--2013829549', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:14:12 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 2G Sep 28 15:14:12 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35eb7937-de07-4737-91aa-b1e90d713ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb', 'volume_size': 1, 'image_id': 'bd093a32-4f6a-429e-8a24-33792f871ad9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd093a32-4f6a-429e-8a24-33792f871ad9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2013829549', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dac59a804f7b4afb9350b5ab12a2a9d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd093a32-4f6a-429e-8a24-33792f871ad9', 'created_at': datetime.datetime(2026, 9, 28, 13, 13, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd093a32-4f6a-429e-8a24-33792f871ad9/file', 'properties': {}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce498230-4b1f-4fb9-bd79-597bab15a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Volume volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb (6bc9b104-154f-4db2-b2d8-999d09be7eeb): created successfully Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce498230-4b1f-4fb9-bd79-597bab15a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Flow 'volume_create_manager' (f4f2d9d3-c65e-4e3a-a79d-533e5e887147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-21d16d5f-ed2c-4ab3-8510-e424840cbe80 tempest-TestInstancesWithCinderVolumes-18731654 None] Created volume successfully. Sep 28 15:14:13 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 2G" returned: 0 in 0.535s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:13 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 Sep 28 15:14:13 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:13 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 is being set with open permissions: ugo+rw Sep 28 15:14:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:13 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 Sep 28 15:14:13 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088" returned: 0 in 0.323s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:14 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.info Sep 28 15:14:14 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:14 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.info" returned: 0 in 0.398s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:14 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.info is being set with open permissions: ugo+rw Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:14 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.info Sep 28 15:14:14 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Flow 'volume_create_manager' (368762e2-c10f-4a03-a4bf-c0510ba76016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e06ebe-819d-43f8-935e-52a61d2989d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e06ebe-819d-43f8-935e-52a61d2989d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-21185744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dbf7d6-b581-4756-be85-b584469029b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3330356fc48eea837ed9adf445f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:15Z,use_quota=True,user_id='cb0fc4daa1b447708def742360f386e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9407d0-8ae9-48f6-bc90-c910f740b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9407d0-8ae9-48f6-bc90-c910f740b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:14 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a1e1cb-9e53-41c0-997b-dec66cb629a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a1e1cb-9e53-41c0-997b-dec66cb629a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84dbf7d6-b581-4756-be85-b584469029b4', 'volume_name': 'volume-84dbf7d6-b581-4756-be85-b584469029b4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991ff8bd-2601-411a-b768-a27f698818c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991ff8bd-2601-411a-b768-a27f698818c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e862730d-26c2-40ef-bcb9-45feb7e4f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Volume 84dbf7d6-b581-4756-be85-b584469029b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84dbf7d6-b581-4756-be85-b584469029b4', 'volume_size': 1} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.info" returned: 0 in 0.383s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-21185744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dbf7d6-b581-4756-be85-b584469029b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3330356fc48eea837ed9adf445f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:15Z,use_quota=True,user_id='cb0fc4daa1b447708def742360f386e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Creating volume 84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:14 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:14:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:14 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 1073741824 Sep 28 15:14:14 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-76bbdaa4-94c7-48f9-8fc5-5f1f06dede64 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Create snapshot completed successfully Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "cinder-cad66a8a-271d-4621-872b-05dc06a95088-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-cad66a8a-271d-4621-872b-05dc06a95088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "cinder-quobyte-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-quobyte-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "cinder-quobyte-cad66a8a-271d-4621-872b-05dc06a95088" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-quobyte-cad66a8a-271d-4621-872b-05dc06a95088" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Deleting offline snapshot cad66a8a-271d-4621-872b-05dc06a95088 of volume 27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:14:15 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] snapshot_file for this snap is: volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 1073741824" returned: 0 in 1.010s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d367eba8-9a72-4639-bd11-b014dbc5f373]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:16 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 Sep 28 15:14:16 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:16 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 Sep 28 15:14:16 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:16 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4" returned: 0 in 0.626s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e862730d-26c2-40ef-bcb9-45feb7e4f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dbf7d6-b581-4756-be85-b584469029b4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1e1d2f-8c1d-4d0f-8129-cf35a7b783fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:16 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Volume volume-84dbf7d6-b581-4756-be85-b584469029b4 (84dbf7d6-b581-4756-be85-b584469029b4): created successfully Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1e1d2f-8c1d-4d0f-8129-cf35a7b783fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Flow 'volume_create_manager' (368762e2-c10f-4a03-a4bf-c0510ba76016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b11e7f5c-871b-4266-b858-bb98d79b5039 tempest-VolumesCloneTest-1848853144 None] Created volume successfully. Sep 28 15:14:16 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088" returned: 0 in 0.926s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:17 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfe1a4c-8321-4d31-be00-e947d9715efe]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 Sep 28 15:14:17 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:17 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" returned: 0 in 0.720s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 Sep 28 15:14:17 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:18 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088" returned: 0 in 0.648s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:18 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088 Sep 28 15:14:18 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:19 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1.cad66a8a-271d-4621-872b-05dc06a95088" returned: 0 in 0.696s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-quobyte-cad66a8a-271d-4621-872b-05dc06a95088" released by "_delete_snapshot" :: held 3.346s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-quobyte-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" released by "delete_snapshot" :: held 3.417s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Created reservations ['87f21f65-c277-4ecb-a11e-8751d1134de0', '2c167fc8-1302-4a63-aa99-ec5a61c2ad1c', 'f487e68e-1b79-4520-922d-2c00aed93751', 'd7589dd4-4fc5-469b-8412-e3a49a789d0b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Flow 'volume_create_manager' (8d60108f-7c9c-4c24-8959-aa7033c785c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8fbb06-f0b5-4d91-a85b-c804f723e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Delete snapshot completed successfully. Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2701b793-85a0-4c86-9e50-5a14bfa89511 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-cad66a8a-271d-4621-872b-05dc06a95088-delete_snapshot" released by "delete_snapshot" :: held 3.992s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8fbb06-f0b5-4d91-a85b-c804f723e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-708373967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f1f9e2-85f8-4822-8902-7b95ec539d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3330356fc48eea837ed9adf445f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=84dbf7d6-b581-4756-be85-b584469029b4,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:19Z,use_quota=True,user_id='cb0fc4daa1b447708def742360f386e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0732a684-3007-4474-ac73-d11f8d238069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0732a684-3007-4474-ac73-d11f8d238069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848605cc-41ef-4525-aa02-06692886135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848605cc-41ef-4525-aa02-06692886135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b3f1f9e2-85f8-4822-8902-7b95ec539d93', 'volume_name': 'volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93', 'volume_size': 2, 'source_volid': '84dbf7d6-b581-4756-be85-b584469029b4', 'source_volstatus': 'available'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7062df5d-08ba-4f62-b3af-11cb6e9578c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7062df5d-08ba-4f62-b3af-11cb6e9578c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd0503f-1afc-49d5-8496-813c4d95c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:19 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Volume b3f1f9e2-85f8-4822-8902-7b95ec539d93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93', 'volume_size': 2, 'source_volid': '84dbf7d6-b581-4756-be85-b584469029b4', 'source_volstatus': 'available'} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-022e9579-58f1-421d-80ca-633b341aad4c req-bf6947aa-4bdb-4cff-a0b9-a303b4dc7259 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-022e9579-58f1-421d-80ca-633b341aad4c req-bf6947aa-4bdb-4cff-a0b9-a303b4dc7259 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-022e9579-58f1-421d-80ca-633b341aad4c req-bf6947aa-4bdb-4cff-a0b9-a303b4dc7259 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:19 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Cloning volume 84dbf7d6-b581-4756-be85-b584469029b4 to volume b3f1f9e2-85f8-4822-8902-7b95ec539d93 Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Creating offline snapshot 361fa7ae-4261-48e7-b2b0-dd66d4c9e53c of volume 84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-022e9579-58f1-421d-80ca-633b341aad4c req-bf6947aa-4bdb-4cff-a0b9-a303b4dc7259 tempest-TestInstancesWithCinderVolumes-18731654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9b72273-7faa-4c0f-82ee-98d14f4f20e2', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[032cf78f-6923-4457-8d52-20d5937fab55]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-022e9579-58f1-421d-80ca-633b341aad4c req-bf6947aa-4bdb-4cff-a0b9-a303b4dc7259 tempest-TestInstancesWithCinderVolumes-18731654 None] attachment_update completed successfully. Sep 28 15:14:20 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 Sep 28 15:14:20 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "cinder-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "cinder-quobyte-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:20 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4" returned: 0 in 0.944s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-quobyte-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" acquired by "delete_volume" :: waited 0.058s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:20 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c 1G Sep 28 15:14:20 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa1d36-953d-4e0c-88ea-add541b0dd77]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:21 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 Sep 28 15:14:21 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:21 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c 1G" returned: 0 in 0.745s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84dbf7d6-b581-4756-be85-b584469029b4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:21 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84dbf7d6-b581-4756-be85-b584469029b4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c Sep 28 15:14:21 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:21 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" returned: 0 in 0.688s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:21 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1 Sep 28 15:14:21 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:22 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84dbf7d6-b581-4756-be85-b584469029b4 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" returned: 0 in 0.591s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:22 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c is being set with open permissions: ugo+rw Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:22 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:22 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" returned: 0 in 0.581s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:22 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-quobyte-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1" released by "delete_volume" :: held 1.419s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Created reservations ['2288c408-93e0-4c00-a091-cf0c5cf20be8', '55bd071a-9460-443b-944b-18bddd87eb16', '8ba953f0-6eb0-4a29-9152-051525f60b5e', '6dfafda7-329e-4159-991f-d1a2200e6681'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:22 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:14:22 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:22 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" returned: 0 in 0.650s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:22 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.info Sep 28 15:14:22 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:22 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.431s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:23 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Deleted volume successfully. Sep 28 15:14:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-bb5eb43c-1d44-4851-a185-ee6c545e26f3 tempest-VolumesSnapshotNegativeTestJSON-90285 None] Lock "cinder-27b4c806-4fce-4ea1-aa9e-7e9637cd8ac1-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:23 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.info" returned: 0 in 0.574s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:23 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.info is being set with open permissions: ugo+rw Sep 28 15:14:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:23 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.info Sep 28 15:14:23 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:24 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.info" returned: 0 in 1.012s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Acquiring lock "cinder-quobyte-b3f1f9e2-85f8-4822-8902-7b95ec539d93" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-b3f1f9e2-85f8-4822-8902-7b95ec539d93" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] snapshot: 361fa7ae-4261-48e7-b2b0-dd66d4c9e53c, volume: b3f1f9e2-85f8-4822-8902-7b95ec539d93, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8100518-e1c0-4445-abae-c47de44e9f66]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:24 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c Sep 28 15:14:24 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:25 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" returned: 0 in 0.583s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84dbf7d6-b581-4756-be85-b584469029b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ab4027-e825-4d61-ac5e-2b1bcfdd097d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:25 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 Sep 28 15:14:25 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:26 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4" returned: 0 in 0.806s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:14:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:14:26 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:14:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:26 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 Sep 28 15:14:26 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:32 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=95,cinder:UPDATE=105,cinder:INSERT=34,cinder:DELETE=9 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=105,cinder:UPDATE=90,cinder:INSERT=36,cinder:DELETE=7 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:33 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:14:33 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:34 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 1.046s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:14:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:14:42 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93" returned: 0 in 16.496s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:42 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4, size 1024.00 MB, duration 16.50 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:14:42 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Converted 1024.00 MB image at 62.06 MB/s Sep 28 15:14:42 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 is being set with open permissions: ugo+rw Sep 28 15:14:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:42 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 Sep 28 15:14:42 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:42 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93" returned: 0 in 0.391s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-b3f1f9e2-85f8-4822-8902-7b95ec539d93" released by "_copy_volume_from_snapshot" :: held 18.427s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Acquiring lock "cinder-quobyte-361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Deleting offline snapshot 361fa7ae-4261-48e7-b2b0-dd66d4c9e53c of volume 84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:14:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] snapshot_file for this snap is: volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:14:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf76f46b-23f2-4ae1-8f5b-720426b19aa8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:43 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c Sep 28 15:14:43 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:44 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" returned: 0 in 0.941s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84dbf7d6-b581-4756-be85-b584469029b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:44 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b353ad20-ee7b-4b5a-a06e-b4a8a36fbc87]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:44 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 Sep 28 15:14:44 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:45 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4" returned: 0 in 1.016s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:45 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c Sep 28 15:14:45 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:45 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" returned: 0 in 0.496s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:45 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c Sep 28 15:14:45 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:46 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4.361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-361fa7ae-4261-48e7-b2b0-dd66d4c9e53c" released by "_delete_snapshot" :: held 3.111s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 26.454s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd0503f-1afc-49d5-8496-813c4d95c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93', 'volume_size': 2, 'source_volid': '84dbf7d6-b581-4756-be85-b584469029b4', 'source_volstatus': 'available'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5524ae11-96b6-43ce-bf46-525dd8fca528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:46 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Volume volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 (b3f1f9e2-85f8-4822-8902-7b95ec539d93): created successfully Sep 28 15:14:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5524ae11-96b6-43ce-bf46-525dd8fca528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Flow 'volume_create_manager' (8d60108f-7c9c-4c24-8959-aa7033c785c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:46 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4c4ba163-e296-431d-8129-415a6850d85e tempest-VolumesCloneTest-1848853144 None] Created volume successfully. Sep 28 15:14:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "cinder-b3f1f9e2-85f8-4822-8902-7b95ec539d93-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-b3f1f9e2-85f8-4822-8902-7b95ec539d93-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "cinder-quobyte-b3f1f9e2-85f8-4822-8902-7b95ec539d93" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-b3f1f9e2-85f8-4822-8902-7b95ec539d93" acquired by "delete_volume" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:47 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888ffb4-52a0-4128-9529-7fce16c94d4a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:48 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 Sep 28 15:14:48 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:48 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93" returned: 0 in 0.491s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:48 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93 Sep 28 15:14:48 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:49 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b3f1f9e2-85f8-4822-8902-7b95ec539d93" returned: 0 in 0.583s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-b3f1f9e2-85f8-4822-8902-7b95ec539d93" released by "delete_volume" :: held 1.169s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Created reservations ['e81b6c4f-cae1-4a9e-8f35-668dbb6d04fd', 'a562f88e-0db6-4e65-b992-ca45cd2b9000', '707690ed-fd0e-433f-9d62-3aaaea7ba495', 'bb7fa156-e02d-44e2-870a-dbacafe62bea'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:49 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:14:49 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:49 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.481s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Deleted volume successfully. Sep 28 15:14:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3af1adcb-c840-4e85-8ff5-dd7caf6f5f43 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-b3f1f9e2-85f8-4822-8902-7b95ec539d93-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "cinder-84dbf7d6-b581-4756-be85-b584469029b4-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-84dbf7d6-b581-4756-be85-b584469029b4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "cinder-quobyte-84dbf7d6-b581-4756-be85-b584469029b4" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-84dbf7d6-b581-4756-be85-b584469029b4" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[182ab63a-d3bc-44bb-9a32-1ba748d165b6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:50 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 Sep 28 15:14:50 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:51 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4" returned: 0 in 0.759s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:51 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4 Sep 28 15:14:51 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:51 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-84dbf7d6-b581-4756-be85-b584469029b4" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-quobyte-84dbf7d6-b581-4756-be85-b584469029b4" released by "delete_volume" :: held 1.362s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Created reservations ['1c6de6ff-af46-4f59-bcc8-234a6b55a45b', 'b5dc237f-3669-4a00-a3cd-53fd28d5d17c', '37d24263-e1f1-4871-bbd8-67b1858684e0', 'd5d93105-56e5-4238-918b-a04bde4c9f16'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:52 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:14:52 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:52 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.423s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Deleted volume successfully. Sep 28 15:14:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-277e9858-853e-4f7f-802e-2b3ca3ca2e14 tempest-VolumesCloneTest-1848853144 None] Lock "cinder-84dbf7d6-b581-4756-be85-b584469029b4-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Flow 'volume_create_manager' (4aea05bc-9155-468b-b26c-20617cff4d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f863ab-45a3-42b8-b638-81497b9c5aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f863ab-45a3-42b8-b638-81497b9c5aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530676036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df647b6-c4c0-4b64-8339-12c6510aabd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eddf75faf4344ada8667ac6ccedcff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:58Z,use_quota=True,user_id='3eca543418f14deabd6daf4e0275df4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aacd8ec-5b27-49c1-b44b-ed6e6885e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aacd8ec-5b27-49c1-b44b-ed6e6885e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c51bd-f5af-4cf6-9d98-3356fc8f259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:58 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c51bd-f5af-4cf6-9d98-3356fc8f259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6df647b6-c4c0-4b64-8339-12c6510aabd7', 'volume_name': 'volume-6df647b6-c4c0-4b64-8339-12c6510aabd7', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf265a50-e650-4e71-ae64-177b38260daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf265a50-e650-4e71-ae64-177b38260daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c3437-cb0e-4190-b9b0-6e05e454983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Volume 6df647b6-c4c0-4b64-8339-12c6510aabd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6df647b6-c4c0-4b64-8339-12c6510aabd7', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Trying to clone 6df647b6-c4c0-4b64-8339-12c6510aabd7 from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd at location (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:14:59 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9325513-120f-433b-a7bd-18c09a651135]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:59 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD Sep 28 15:14:59 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:59 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd is fetched for user 3eca543418f14deabd6daf4e0275df4d. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0171e5c-cd34-47c0-b430-87e7c136381e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:00 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD Sep 28 15:15:00 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:00 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530676036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df647b6-c4c0-4b64-8339-12c6510aabd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eddf75faf4344ada8667ac6ccedcff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:58Z,use_quota=True,user_id='3eca543418f14deabd6daf4e0275df4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Creating volume 6df647b6-c4c0-4b64-8339-12c6510aabd7 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:00 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:00 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 1073741824 Sep 28 15:15:00 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:00 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 1073741824" returned: 0 in 0.563s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:00 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 Sep 28 15:15:00 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:01 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Attempting download of 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume 6df647b6-c4c0-4b64-8339-12c6510aabd7. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1face1-0746-4054-a292-af8a68a03811]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_dkh23i_o {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:01 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_dkh23i_o Sep 28 15:15:01 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:01 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_dkh23i_o" returned: 0 in 0.446s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_dkh23i_o {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_dkh23i_o Sep 28 15:15:02 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_dkh23i_o" returned: 1 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_dkh23i_o' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f73263-ed1a-4b4e-867f-78af1bb19d1c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD Sep 28 15:15:02 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd was qcow2, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:15:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 Sep 28 15:15:02 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:05 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7" returned: 0 in 2.692s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:05 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd_5s03hwybdevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:15:05 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Converted 112.00 MB image at 41.58 MB/s Sep 28 15:15:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:05 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 1G Sep 28 15:15:05 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:06 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 1G" returned: 0 in 0.599s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Downloaded image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}])) to volume 6df647b6-c4c0-4b64-8339-12c6510aabd7 successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Temporary image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd for user 3eca543418f14deabd6daf4e0275df4d is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Marking volume 6df647b6-c4c0-4b64-8339-12c6510aabd7 as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Copying metadata from image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd to 6df647b6-c4c0-4b64-8339-12c6510aabd7. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Creating volume glance metadata for volume 6df647b6-c4c0-4b64-8339-12c6510aabd7 backed by image 20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c3437-cb0e-4190-b9b0-6e05e454983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df647b6-c4c0-4b64-8339-12c6510aabd7', 'volume_size': 1, 'image_id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91c14df74e464034aa7f771b4fe56fea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20acaff9-af0c-4f5a-a6d0-dcb5b2783ecd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdbe10a-b5d8-49e9-a237-9e06d7320278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Volume volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 (6df647b6-c4c0-4b64-8339-12c6510aabd7): created successfully Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdbe10a-b5d8-49e9-a237-9e06d7320278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Flow 'volume_create_manager' (4aea05bc-9155-468b-b26c-20617cff4d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-15591792-1032-4c5d-9db5-2ac40c304544 req-7cd30e71-8faa-4d14-9ec1-3d073c65fc09 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-15591792-1032-4c5d-9db5-2ac40c304544 req-7cd30e71-8faa-4d14-9ec1-3d073c65fc09 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-06135664-0b9d-4421-a193-cb0ad018519a tempest-VolumesExtendTest-476771391 None] Created volume successfully. Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-15591792-1032-4c5d-9db5-2ac40c304544 req-7cd30e71-8faa-4d14-9ec1-3d073c65fc09 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-15591792-1032-4c5d-9db5-2ac40c304544 req-7cd30e71-8faa-4d14-9ec1-3d073c65fc09 tempest-TestInstancesWithCinderVolumes-18731654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b05624f-1f6e-4b5e-bdd7-ea6b81f62cde', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:15:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-15591792-1032-4c5d-9db5-2ac40c304544 req-7cd30e71-8faa-4d14-9ec1-3d073c65fc09 tempest-TestInstancesWithCinderVolumes-18731654 None] attachment_update completed successfully. Sep 28 15:15:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:07 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab870103-df46-4bb6-ba49-c80fa0181e57]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:07 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 Sep 28 15:15:07 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:08 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7" returned: 0 in 0.587s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 2G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 2G" returned: 0 in 0.150s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.788s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f5c7a4c1-fb9c-4e4d-8480-06f9892af253 tempest-VolumesExtendTest-476771391 None] Extend volume completed successfully. Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Acquiring lock "cinder-6df647b6-c4c0-4b64-8339-12c6510aabd7-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Lock "cinder-6df647b6-c4c0-4b64-8339-12c6510aabd7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Acquiring lock "cinder-quobyte-6df647b6-c4c0-4b64-8339-12c6510aabd7" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-6df647b6-c4c0-4b64-8339-12c6510aabd7" acquired by "delete_volume" :: waited 0.047s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d980ef-5e93-43db-bbbe-b2cc2e15f84c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:09 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 Sep 28 15:15:09 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:09 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7" returned: 0 in 0.689s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:10 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7 Sep 28 15:15:10 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-47535a23-a350-4d57-89dc-c4d704cb449c req-8f1014da-6ff9-4888-b1a1-3abe63eb0708 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-47535a23-a350-4d57-89dc-c4d704cb449c req-8f1014da-6ff9-4888-b1a1-3abe63eb0708 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-47535a23-a350-4d57-89dc-c4d704cb449c req-8f1014da-6ff9-4888-b1a1-3abe63eb0708 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-47535a23-a350-4d57-89dc-c4d704cb449c req-8f1014da-6ff9-4888-b1a1-3abe63eb0708 tempest-TestInstancesWithCinderVolumes-18731654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc47a025-9421-4c3e-a97b-19ee5a6be98d', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:15:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-47535a23-a350-4d57-89dc-c4d704cb449c req-8f1014da-6ff9-4888-b1a1-3abe63eb0708 tempest-TestInstancesWithCinderVolumes-18731654 None] attachment_update completed successfully. Sep 28 15:15:10 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6df647b6-c4c0-4b64-8339-12c6510aabd7" returned: 0 in 0.386s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-6df647b6-c4c0-4b64-8339-12c6510aabd7" released by "delete_volume" :: held 1.159s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Created reservations ['7d8be2b8-fe32-426f-83ed-46f0d9e36f28', '42b2609c-fe3c-4a88-8e81-30dda2fd6509', 'bcd538b5-94e1-44be-a174-cf219cc711c4', '966fe4d2-f04f-49b1-8dad-bcfc514b161f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:10 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:15:10 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:11 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.361s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:11 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Deleted volume successfully. Sep 28 15:15:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4a748aa2-4c07-44d4-822a-f1393035d88d tempest-VolumesExtendTest-476771391 None] Lock "cinder-6df647b6-c4c0-4b64-8339-12c6510aabd7-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Flow 'volume_create_manager' (9facaf74-fb93-4955-bee3-6eac4c1ed44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14b8170-68e5-40b3-addf-f3bd298dcef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14b8170-68e5-40b3-addf-f3bd298dcef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1081382735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eddf75faf4344ada8667ac6ccedcff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:12Z,use_quota=True,user_id='3eca543418f14deabd6daf4e0275df4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe72ec6-4204-4d5b-b571-6d4378dc7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe72ec6-4204-4d5b-b571-6d4378dc7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4ae4bb-ea9d-4507-9b04-2e174f1db2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4ae4bb-ea9d-4507-9b04-2e174f1db2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60', 'volume_name': 'volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4acea8-2269-4364-9e52-a82486f53a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4acea8-2269-4364-9e52-a82486f53a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d208378-724d-483f-93b4-e54114ad0c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Volume 0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60', 'volume_size': 1} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1081382735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eddf75faf4344ada8667ac6ccedcff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:12Z,use_quota=True,user_id='3eca543418f14deabd6daf4e0275df4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Creating volume 0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:12 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:15:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:12 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 1073741824 Sep 28 15:15:12 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:13 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-ce98d571-5a2a-479d-a79b-dd3bad075ad6 req-050ed65c-5fbc-4856-86a2-416962dbc598 tempest-TestShelveInstance-812357556 None] Terminate volume connection completed successfully. Sep 28 15:15:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-ce98d571-5a2a-479d-a79b-dd3bad075ad6 req-050ed65c-5fbc-4856-86a2-416962dbc598 tempest-TestShelveInstance-812357556 None] Deleting attachment bf017cbb-edc1-45ce-ba89-2a3ba67e2683. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:13 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 1073741824" returned: 0 in 1.026s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:13 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 Sep 28 15:15:13 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:14 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" returned: 0 in 0.474s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d208378-724d-483f-93b4-e54114ad0c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83e2f11-36b7-4a42-8902-0512c645fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Volume volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 (0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60): created successfully Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83e2f11-36b7-4a42-8902-0512c645fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Flow 'volume_create_manager' (9facaf74-fb93-4955-bee3-6eac4c1ed44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a8dc08bc-5d5e-4110-8b73-1e5dcaeddd7d tempest-VolumesExtendTest-476771391 None] Created volume successfully. Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Creating offline snapshot c71da943-c3e0-4377-a99b-2d8062fd2b53 of volume 0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe7f217-edb7-4fbf-911c-c1604572e4c6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:14 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 Sep 28 15:15:14 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:15 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" returned: 0 in 0.520s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:15 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 1G Sep 28 15:15:15 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:15 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 1G" returned: 0 in 0.740s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:15 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 Sep 28 15:15:15 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:16 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53" returned: 0 in 0.465s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:16 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 is being set with open permissions: ugo+rw Sep 28 15:15:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:16 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 Sep 28 15:15:16 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:16 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53" returned: 0 in 0.496s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:16 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.info Sep 28 15:15:17 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-dca976d5-6bca-44f6-80f2-7adcd399ee2e req-5f5c7e0c-2565-4129-917d-70dfec7d612c tempest-TestShelveInstance-812357556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:17 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.info" returned: 0 in 0.312s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:17 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.info is being set with open permissions: ugo+rw Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:17 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.info Sep 28 15:15:17 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:17 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.info" returned: 0 in 0.377s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-dca976d5-6bca-44f6-80f2-7adcd399ee2e req-5f5c7e0c-2565-4129-917d-70dfec7d612c tempest-TestShelveInstance-812357556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.563s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-dca976d5-6bca-44f6-80f2-7adcd399ee2e req-5f5c7e0c-2565-4129-917d-70dfec7d612c tempest-TestShelveInstance-812357556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.076s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a1c81bac-cc1f-4293-a83a-99904ef79be4 tempest-VolumesExtendTest-476771391 None] Create snapshot completed successfully Sep 28 15:15:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-dca976d5-6bca-44f6-80f2-7adcd399ee2e req-5f5c7e0c-2565-4129-917d-70dfec7d612c tempest-TestShelveInstance-812357556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-0cf2894f-0559-4281-bb26-2f1f333f3434', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe00c971-6507-4f8c-bd4a-d83ce42983a9', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:15:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-dca976d5-6bca-44f6-80f2-7adcd399ee2e req-5f5c7e0c-2565-4129-917d-70dfec7d612c tempest-TestShelveInstance-812357556 None] attachment_update completed successfully. Sep 28 15:15:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-1bcd8af8-193d-4ce5-9f8d-a11a3ebbd1c7 req-323aacd5-1ab3-4ce5-9e28-7b29b5101dfb tempest-TestInstancesWithCinderVolumes-18731654 None] Terminate volume connection completed successfully. Sep 28 15:15:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-1bcd8af8-193d-4ce5-9f8d-a11a3ebbd1c7 req-323aacd5-1ab3-4ce5-9e28-7b29b5101dfb tempest-TestInstancesWithCinderVolumes-18731654 None] Deleting attachment 5b05624f-1f6e-4b5e-bdd7-ea6b81f62cde. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "cinder-78aeeea4-cd7f-45e4-8617-d0aca3856bf1-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-78aeeea4-cd7f-45e4-8617-d0aca3856bf1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "cinder-quobyte-78aeeea4-cd7f-45e4-8617-d0aca3856bf1" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-quobyte-78aeeea4-cd7f-45e4-8617-d0aca3856bf1" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a799919b-e211-48fe-9749-b276d8c818b9]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e79ce0-81e5-4a50-b124-2fae6db718d0]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:19 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 Sep 28 15:15:19 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:19 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 Sep 28 15:15:19 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:19 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1" returned: 0 in 0.603s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:19 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1 Sep 28 15:15:19 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:19 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" returned: 0 in 0.895s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 2G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:20 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-78aeeea4-cd7f-45e4-8617-d0aca3856bf1" returned: 0 in 0.605s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-quobyte-78aeeea4-cd7f-45e4-8617-d0aca3856bf1" released by "delete_volume" :: held 1.318s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:20 devstack cinder-volume[86384]: WARNING cinder.quota [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2108972369-726178159 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2108972369-726178159, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:20 devstack cinder-volume[86384]: WARNING cinder.quota [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2108972369-726178159 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2108972369-726178159, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 2G" returned: 0 in 0.320s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.286s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Created reservations ['a6842375-661d-435d-a6bb-db41bb094d7e', 'a68af0a7-16b2-4035-835c-db00d9383535', 'a5b32ca0-ec10-4fee-bc76-a04d5fa7a6e3', 'cae68fbf-0a77-4301-b269-6ac93d912bc0'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9ab207f8-a7a0-4675-aeee-1d7a9080da3f tempest-VolumesExtendTest-476771391 None] Extend volume completed successfully. Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:20 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:15:20 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:21 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.504s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Deleted volume successfully. Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7d651174-3f27-4d58-8928-d9af4bdc8795 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-78aeeea4-cd7f-45e4-8617-d0aca3856bf1-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Acquiring lock "cinder-c71da943-c3e0-4377-a99b-2d8062fd2b53-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Lock "cinder-c71da943-c3e0-4377-a99b-2d8062fd2b53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Acquiring lock "cinder-quobyte-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Acquiring lock "cinder-quobyte-c71da943-c3e0-4377-a99b-2d8062fd2b53" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-c71da943-c3e0-4377-a99b-2d8062fd2b53" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Deleting offline snapshot c71da943-c3e0-4377-a99b-2d8062fd2b53 of volume 0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] snapshot_file for this snap is: volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c8fbbc-a042-4be8-9893-6a82cd6a6836]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:21 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 Sep 28 15:15:21 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:22 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53" returned: 0 in 0.566s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:22 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac98519-a54f-464a-b29e-324306ce1c9e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:22 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 Sep 28 15:15:22 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:23 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" returned: 0 in 0.929s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:23 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 Sep 28 15:15:23 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:24 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53" returned: 0 in 0.938s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:24 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53 Sep 28 15:15:24 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:24 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60.c71da943-c3e0-4377-a99b-2d8062fd2b53" returned: 0 in 0.671s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-c71da943-c3e0-4377-a99b-2d8062fd2b53" released by "_delete_snapshot" :: held 3.318s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" released by "delete_snapshot" :: held 3.354s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:25 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Created reservations ['5adecd59-2d38-433d-b3a4-cad0bc7dcdb4', '4c9bcf6a-e267-4662-be56-3ab3f5f6ba24', '310f55c5-8a7c-4ea0-916d-f2140735c653', 'd07d23b9-a1a4-4e8d-a9d0-4dd1eca74f76'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-5624d837-2bf7-4d49-a78c-4ff52bfa49a3 req-3c5894e5-bdf0-4134-83a4-2cbad352af29 tempest-TestInstancesWithCinderVolumes-18731654 None] Terminate volume connection completed successfully. Sep 28 15:15:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-5624d837-2bf7-4d49-a78c-4ff52bfa49a3 req-3c5894e5-bdf0-4134-83a4-2cbad352af29 tempest-TestInstancesWithCinderVolumes-18731654 None] Deleting attachment bc47a025-9421-4c3e-a97b-19ee5a6be98d. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Delete snapshot completed successfully. Sep 28 15:15:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6949c33e-ed51-41a4-bdab-29ecccee6fa5 tempest-VolumesExtendTest-476771391 None] Lock "cinder-c71da943-c3e0-4377-a99b-2d8062fd2b53-delete_snapshot" released by "delete_snapshot" :: held 3.762s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "cinder-908cfcea-aeea-4878-a88e-fbde42d6f5c4-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-908cfcea-aeea-4878-a88e-fbde42d6f5c4-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Acquiring lock "cinder-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "cinder-quobyte-908cfcea-aeea-4878-a88e-fbde42d6f5c4" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-quobyte-908cfcea-aeea-4878-a88e-fbde42d6f5c4" acquired by "delete_volume" :: waited 0.069s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Lock "cinder-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2aa13-d540-4e62-8ed3-cdd7aeb5604f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Acquiring lock "cinder-quobyte-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" acquired by "delete_volume" :: waited 0.069s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 Sep 28 15:15:26 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385d713-2121-4152-8bd8-126cfa24aca4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:27 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 Sep 28 15:15:27 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:27 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4" returned: 0 in 1.177s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:27 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4 Sep 28 15:15:27 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:28 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" returned: 0 in 1.234s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:28 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60 Sep 28 15:15:28 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:28 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-908cfcea-aeea-4878-a88e-fbde42d6f5c4" returned: 0 in 1.020s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-quobyte-908cfcea-aeea-4878-a88e-fbde42d6f5c4" released by "delete_volume" :: held 2.427s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:28 devstack cinder-volume[86384]: WARNING cinder.quota [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357038620-648223214 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357038620-648223214, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:28 devstack cinder-volume[86384]: WARNING cinder.quota [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357038620-648223214 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357038620-648223214, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Created reservations ['bd0c0bef-54f6-4cb5-9f3f-a79c5489cfcc', '90f35a21-8fbc-4819-b54e-08a9c1b9aa7e', 'f8a0be3d-8cde-4813-b8af-6c3f13eee501', '9c5a3af9-a233-4f23-8d18-2b0bd5b2c090'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:29 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" returned: 0 in 1.110s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Lock "cinder-quobyte-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60" released by "delete_volume" :: held 2.610s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:29 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:15:29 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Created reservations ['a0f20496-54b8-4982-8c74-08cf9785cb18', '6250913c-bc8c-4445-9c96-cb833d948dc2', '56fe03e1-6a65-4e81-850f-7d13896bdac0', 'f9137688-9cd1-4cdd-a1c6-e257e6996342'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:30 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:15:30 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:30 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.750s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:30 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Deleted volume successfully. Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a764c838-9b6f-4e20-ad48-553daf0a90b1 tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-908cfcea-aeea-4878-a88e-fbde42d6f5c4-delete_volume" released by "delete_volume" :: held 4.371s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:30 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.855s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:30 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Deleted volume successfully. Sep 28 15:15:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-83c3b963-e074-4100-a94b-1a6ede66919f tempest-VolumesExtendTest-476771391 None] Lock "cinder-0b3d2dbb-10a7-43c4-abd2-6fa5f329ba60-delete_volume" released by "delete_volume" :: held 4.469s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:33 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:15:33 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:34 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.890s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:15:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:15:37 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=83,cinder:UPDATE=76,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:37 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-67a81a2b-eb45-4a16-9f32-74b7f9188e86 req-fda2d49a-d6ae-4027-afe7-be07b3c773d2 tempest-TestInstancesWithCinderVolumes-18731654 None] Terminate volume connection completed successfully. Sep 28 15:15:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-67a81a2b-eb45-4a16-9f32-74b7f9188e86 req-fda2d49a-d6ae-4027-afe7-be07b3c773d2 tempest-TestInstancesWithCinderVolumes-18731654 None] Deleting attachment a9b72273-7faa-4c0f-82ee-98d14f4f20e2. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "cinder-6bc9b104-154f-4db2-b2d8-999d09be7eeb-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-6bc9b104-154f-4db2-b2d8-999d09be7eeb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "cinder-quobyte-6bc9b104-154f-4db2-b2d8-999d09be7eeb" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-quobyte-6bc9b104-154f-4db2-b2d8-999d09be7eeb" acquired by "delete_volume" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c616b-23d2-4d76-975c-15b58cd69794]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:39 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb Sep 28 15:15:39 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:39 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb" returned: 0 in 0.654s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:39 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb Sep 28 15:15:39 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:40 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6bc9b104-154f-4db2-b2d8-999d09be7eeb" returned: 0 in 0.482s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-quobyte-6bc9b104-154f-4db2-b2d8-999d09be7eeb" released by "delete_volume" :: held 1.204s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:40 devstack cinder-volume[86384]: WARNING cinder.quota [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310547218-583308832 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310547218-583308832, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:40 devstack cinder-volume[86384]: WARNING cinder.quota [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310547218-583308832 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310547218-583308832, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Created reservations ['d703e7a3-45c4-434a-977d-6ae4fca0b1aa', 'bfdaefc7-ec7c-493d-943d-194e14768090', '1ac10d22-c493-4c37-a8d7-efa1d97946e9', 'cb527419-b70b-4a57-a7d9-7ec542a964c6'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:40 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:15:40 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:41 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.434s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:41 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Deleted volume successfully. Sep 28 15:15:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-41e48473-f97f-462e-8cfd-6bb1aea7b78a tempest-TestInstancesWithCinderVolumes-18731654 None] Lock "cinder-6bc9b104-154f-4db2-b2d8-999d09be7eeb-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:50 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=85,cinder:SELECT=80,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:51 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Flow 'volume_create_manager' (2793e8ee-7e0b-4bd6-85d0-9c3cc8e15f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735da0b5-9151-4851-a86d-3b860b82c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735da0b5-9151-4851-a86d-3b860b82c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1961383243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b10f5d3-650b-4313-bbc2-60a9b2fc76ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ca678bd9a5445d9ee9489eafec3319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:02Z,use_quota=True,user_id='59d4cc8725ae47e88820a267125d78ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cc4614-99a3-423d-8fd8-c7a51bf7739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cc4614-99a3-423d-8fd8-c7a51bf7739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7f493f-f9aa-4762-8fd6-236ed75b6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7f493f-f9aa-4762-8fd6-236ed75b6b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b10f5d3-650b-4313-bbc2-60a9b2fc76ab', 'volume_name': 'volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabc27c2-ca22-4296-8e6e-988f30cff08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabc27c2-ca22-4296-8e6e-988f30cff08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37491ec-9200-4646-9c4a-69813b8b68f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Volume 0b10f5d3-650b-4313-bbc2-60a9b2fc76ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab', 'volume_size': 1} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1961383243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b10f5d3-650b-4313-bbc2-60a9b2fc76ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ca678bd9a5445d9ee9489eafec3319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:02Z,use_quota=True,user_id='59d4cc8725ae47e88820a267125d78ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Creating volume 0b10f5d3-650b-4313-bbc2-60a9b2fc76ab {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:02 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab 1073741824 Sep 28 15:16:02 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab 1073741824" returned: 0 in 0.929s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab Sep 28 15:16:03 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab" returned: 0 in 0.422s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37491ec-9200-4646-9c4a-69813b8b68f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd9d04e-334a-4c19-8704-de75147465bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Volume volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab (0b10f5d3-650b-4313-bbc2-60a9b2fc76ab): created successfully Sep 28 15:16:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd9d04e-334a-4c19-8704-de75147465bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Flow 'volume_create_manager' (2793e8ee-7e0b-4bd6-85d0-9c3cc8e15f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ac9b4281-8de4-49d1-a26c-403f6f1ad3b6 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Created volume successfully. Sep 28 15:16:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-bae794c7-ace3-440e-90a2-ec4987b8d2aa req-3683a8b2-bc32-431d-a361-c0aab8ca0d81 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-bae794c7-ace3-440e-90a2-ec4987b8d2aa req-3683a8b2-bc32-431d-a361-c0aab8ca0d81 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-bae794c7-ace3-440e-90a2-ec4987b8d2aa req-3683a8b2-bc32-431d-a361-c0aab8ca0d81 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-bae794c7-ace3-440e-90a2-ec4987b8d2aa req-3683a8b2-bc32-431d-a361-c0aab8ca0d81 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac5f10de-802d-4a5a-b798-55983962b8cb', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:16:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-bae794c7-ace3-440e-90a2-ec4987b8d2aa req-3683a8b2-bc32-431d-a361-c0aab8ca0d81 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] attachment_update completed successfully. Sep 28 15:16:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-20105049-837e-4300-aca0-9de1cb173bfb req-09e61d2a-a866-4462-8b46-b91942c66e36 tempest-TestShelveInstance-812357556 None] Terminate volume connection completed successfully. Sep 28 15:16:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-20105049-837e-4300-aca0-9de1cb173bfb req-09e61d2a-a866-4462-8b46-b91942c66e36 tempest-TestShelveInstance-812357556 None] Deleting attachment fe00c971-6507-4f8c-bd4a-d83ce42983a9. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:16:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Acquiring lock "cinder-0cf2894f-0559-4281-bb26-2f1f333f3434-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Lock "cinder-0cf2894f-0559-4281-bb26-2f1f333f3434-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Acquiring lock "cinder-quobyte-0cf2894f-0559-4281-bb26-2f1f333f3434" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Lock "cinder-quobyte-0cf2894f-0559-4281-bb26-2f1f333f3434" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:11 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e44cc0-a67f-4093-b1f9-ece7b8ed1b82]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 Sep 28 15:16:12 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-9d690842-fe23-4f36-8881-cf8051902829 req-f52029a0-a3dd-49d8-8c6f-090d54537948 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Terminate volume connection completed successfully. Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-9d690842-fe23-4f36-8881-cf8051902829 req-f52029a0-a3dd-49d8-8c6f-090d54537948 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Deleting attachment ac5f10de-802d-4a5a-b798-55983962b8cb. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (67515e5a-8073-4367-ba7d-fc3466277e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7478ef-97f0-4f06-a178-1f45ebdc3b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7478ef-97f0-4f06-a178-1f45ebdc3b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125861022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afca601-fa99-4855-8ba2-153083073382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:12Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869aa0e-0b67-4b05-b350-e402eba9cd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869aa0e-0b67-4b05-b350-e402eba9cd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f703af06-b73b-4fd3-b4d0-15e5e6fa00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f703af06-b73b-4fd3-b4d0-15e5e6fa00be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afca601-fa99-4855-8ba2-153083073382', 'volume_name': 'volume-1afca601-fa99-4855-8ba2-153083073382', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4328b1-12e5-4d9a-b51d-915085d7628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4328b1-12e5-4d9a-b51d-915085d7628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7366e55e-3ff6-497b-a5fa-c9f7aea11db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Volume 1afca601-fa99-4855-8ba2-153083073382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afca601-fa99-4855-8ba2-153083073382', 'volume_size': 1} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125861022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afca601-fa99-4855-8ba2-153083073382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:12Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Creating volume 1afca601-fa99-4855-8ba2-153083073382 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:12 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434" returned: 0 in 0.976s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 1073741824 Sep 28 15:16:12 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:12 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434 Sep 28 15:16:12 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:13 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0cf2894f-0559-4281-bb26-2f1f333f3434" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Lock "cinder-quobyte-0cf2894f-0559-4281-bb26-2f1f333f3434" released by "delete_volume" :: held 1.417s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (8deb9a31-0a61-472d-a646-cffd3949ceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70eb01c-80bc-4491-bb56-7043427263ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70eb01c-80bc-4491-bb56-7043427263ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1789332468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b5073-1571-46c8-bb63-e76b6e97ae07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:13Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43656629-432e-43e7-8ff8-c7a7f9e19c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43656629-432e-43e7-8ff8-c7a7f9e19c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f40b53-baeb-464e-8e7b-d1bc14bae890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f40b53-baeb-464e-8e7b-d1bc14bae890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1b5073-1571-46c8-bb63-e76b6e97ae07', 'volume_name': 'volume-df1b5073-1571-46c8-bb63-e76b6e97ae07', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d56b9dd-6a8c-496b-b389-3b4217c98330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d56b9dd-6a8c-496b-b389-3b4217c98330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15719fec-38fc-4def-8846-242383c49ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:13 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Volume df1b5073-1571-46c8-bb63-e76b6e97ae07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1b5073-1571-46c8-bb63-e76b6e97ae07', 'volume_size': 1} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.quota [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Created reservations ['f876ac31-5cc4-4271-9176-3a82dae0de0c', 'ba5e20be-8685-4373-9506-336b88fbda0c', '65bb34e6-6ac3-4584-85a7-8aac708bf217', '8ca1f828-6336-4e96-89ff-380608e75ae7'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:13 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 1073741824" returned: 0 in 0.691s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:13 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 Sep 28 15:16:13 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:13 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:13 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:14 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382" returned: 0 in 0.496s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1789332468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b5073-1571-46c8-bb63-e76b6e97ae07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:13Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Creating volume df1b5073-1571-46c8-bb63-e76b6e97ae07 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:14 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7366e55e-3ff6-497b-a5fa-c9f7aea11db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afca601-fa99-4855-8ba2-153083073382', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 1073741824 Sep 28 15:16:14 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c4949e-2322-4ba7-96a9-61c9dba3dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (4650ca33-b45b-42d9-a335-0333ed17a0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af747f01-647d-4536-8910-21934730195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.591s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.manager [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Volume volume-1afca601-fa99-4855-8ba2-153083073382 (1afca601-fa99-4855-8ba2-153083073382): created successfully Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c4949e-2322-4ba7-96a9-61c9dba3dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (67515e5a-8073-4367-ba7d-fc3466277e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Acquiring lock "cinder-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Deleted volume successfully. Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af747f01-647d-4536-8910-21934730195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503026206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48f1120-0f39-4701-9266-95ba37f9a273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:14Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67911bf5-ae59-4759-8074-a4d51cda1902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67911bf5-ae59-4759-8074-a4d51cda1902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33ddfb-e8f5-4310-a635-1ff053edf75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd33ddfb-e8f5-4310-a635-1ff053edf75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48f1120-0f39-4701-9266-95ba37f9a273', 'volume_name': 'volume-e48f1120-0f39-4701-9266-95ba37f9a273', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e4f484-9590-424c-9fd6-af53efd8425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e4f484-9590-424c-9fd6-af53efd8425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da081188-d949-4d9a-baff-d4b597eee18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Volume e48f1120-0f39-4701-9266-95ba37f9a273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48f1120-0f39-4701-9266-95ba37f9a273', 'volume_size': 1} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-19bfd484-f764-4c1d-a1d9-53bb075af7d2 tempest-CreateVolumesFromImageTest-1680718606 None] Created volume successfully. Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "cinder-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab-delete_volume" acquired by "delete_volume" :: waited 0.195s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [req-20105049-837e-4300-aca0-9de1cb173bfb req-64578329-7588-46be-bba1-f86a4c00fc02 tempest-TestShelveInstance-812357556 None] Lock "cinder-0cf2894f-0559-4281-bb26-2f1f333f3434-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Acquiring lock "cinder-quobyte-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "cinder-quobyte-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab" acquired by "delete_volume" :: waited 0.048s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ea043d-019b-4188-8571-362d9c9afb32]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:14 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 1073741824" returned: 0 in 0.876s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:14 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab Sep 28 15:16:14 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (aeccecb5-b2db-4b2c-875c-7fcc4a154643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b3b01a-b45e-4bf2-98b9-a4748abaac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b3b01a-b45e-4bf2-98b9-a4748abaac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-902863086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:15Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926c2be4-9a23-467b-b716-08436fc696f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926c2be4-9a23-467b-b716-08436fc696f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a497de-644f-4450-ad21-d56d981cb826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a497de-644f-4450-ad21-d56d981cb826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa', 'volume_name': 'volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c79682-cee7-473d-a1d7-04ed1d995980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c79682-cee7-473d-a1d7-04ed1d995980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd79c1e0-cf5e-4155-84fd-da6737af2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Volume 1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa', 'volume_size': 1} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:15 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 Sep 28 15:16:15 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab" returned: 0 in 0.808s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:15 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab Sep 28 15:16:15 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07" returned: 0 in 0.422s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503026206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48f1120-0f39-4701-9266-95ba37f9a273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:14Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Creating volume e48f1120-0f39-4701-9266-95ba37f9a273 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:15 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15719fec-38fc-4def-8846-242383c49ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1b5073-1571-46c8-bb63-e76b6e97ae07', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f700b3b8-66e5-4b56-8b27-cea453af3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 1073741824 Sep 28 15:16:15 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Volume volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 (df1b5073-1571-46c8-bb63-e76b6e97ae07): created successfully Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f700b3b8-66e5-4b56-8b27-cea453af3a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (8deb9a31-0a61-472d-a646-cffd3949ceec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (b2ec64e1-1458-47ff-91ae-b42c521147f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a406d-4f61-42b1-b8d2-2dbecc58934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8eb18e03-3502-413a-877f-d298f3742470 tempest-CreateVolumesFromImageTest-1680718606 None] Created volume successfully. Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a406d-4f61-42b1-b8d2-2dbecc58934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983921051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d237b7-0e4a-44b2-a1f8-655f0d978cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:16Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb374cd-96ef-4117-8984-04ee17461803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb374cd-96ef-4117-8984-04ee17461803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f9593-0582-4f3c-bf60-af7f4a318e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f9593-0582-4f3c-bf60-af7f4a318e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d237b7-0e4a-44b2-a1f8-655f0d978cb9', 'volume_name': 'volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66125217-5824-43c6-afce-060ce690a237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66125217-5824-43c6-afce-060ce690a237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b4df0-96d1-4400-9dd5-5d2ace11dc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Volume 64d237b7-0e4a-44b2-a1f8-655f0d978cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9', 'volume_size': 1} Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:15 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab" returned: 0 in 0.438s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "cinder-quobyte-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab" released by "delete_volume" :: held 1.325s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Created reservations ['d6835efb-9c0f-4115-8cfb-f016f52585f7', '0e4c53de-8a8a-47d3-8aec-df6587f6a95b', 'cc121bef-fd04-4c03-992c-618e85dab938', 'c94ef939-c249-40f1-a752-9069c327c326'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:16 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:16 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:16 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 1073741824" returned: 0 in 0.679s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:16 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 Sep 28 15:16:16 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:16 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.424s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Deleted volume successfully. Sep 28 15:16:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c47dc680-12e2-4daf-8750-2538e067eea0 tempest-TestServerVolumeAttachScenarioOldVersion-1142481448 None] Lock "cinder-0b10f5d3-650b-4313-bbc2-60a9b2fc76ab-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:17 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273" returned: 0 in 0.618s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-902863086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:15Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Creating volume 1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:17 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:17 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa 1073741824 Sep 28 15:16:17 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da081188-d949-4d9a-baff-d4b597eee18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48f1120-0f39-4701-9266-95ba37f9a273', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961de5a4-79ad-48f8-bab1-70ed92b6cbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Volume volume-e48f1120-0f39-4701-9266-95ba37f9a273 (e48f1120-0f39-4701-9266-95ba37f9a273): created successfully Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961de5a4-79ad-48f8-bab1-70ed92b6cbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (4650ca33-b45b-42d9-a335-0333ed17a0ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2d2431b1-9e0b-4f25-9052-64b2601697f8 tempest-CreateVolumesFromImageTest-1680718606 None] Created volume successfully. Sep 28 15:16:18 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa 1073741824" returned: 0 in 1.030s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa Sep 28 15:16:18 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:18 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa" returned: 0 in 0.616s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.902s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983921051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d237b7-0e4a-44b2-a1f8-655f0d978cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007d4ff9b6499cb902c4d9d08536d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:16Z,use_quota=True,user_id='44da0a74b6b942a99ef3734c84513307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Creating volume 64d237b7-0e4a-44b2-a1f8-655f0d978cb9 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:18 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd79c1e0-cf5e-4155-84fd-da6737af2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 1073741824 Sep 28 15:16:18 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df5efbf-1753-47b1-80f3-e2f02a07efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Volume volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa (1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa): created successfully Sep 28 15:16:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df5efbf-1753-47b1-80f3-e2f02a07efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (aeccecb5-b2db-4b2c-875c-7fcc4a154643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f6bfe442-712b-4140-8e3a-09f77ff8c87a tempest-CreateVolumesFromImageTest-1680718606 None] Created volume successfully. Sep 28 15:16:19 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 1073741824" returned: 0 in 0.978s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 Sep 28 15:16:19 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9" returned: 0 in 0.298s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b4df0-96d1-4400-9dd5-5d2ace11dc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccc1537-4ab0-4bbd-9d5d-a1c5d7da675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:20 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Volume volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 (64d237b7-0e4a-44b2-a1f8-655f0d978cb9): created successfully Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccc1537-4ab0-4bbd-9d5d-a1c5d7da675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Flow 'volume_create_manager' (b2ec64e1-1458-47ff-91ae-b42c521147f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f83c5b07-35ad-4631-a0a5-8e5b08ca97e6 tempest-CreateVolumesFromImageTest-1680718606 None] Created volume successfully. Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-64d237b7-0e4a-44b2-a1f8-655f0d978cb9-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-64d237b7-0e4a-44b2-a1f8-655f0d978cb9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-quobyte-64d237b7-0e4a-44b2-a1f8-655f0d978cb9" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-64d237b7-0e4a-44b2-a1f8-655f0d978cb9" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0270ed6a-51df-4356-908e-964e04dc87a8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 Sep 28 15:16:20 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9" returned: 0 in 0.600s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9 Sep 28 15:16:21 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-64d237b7-0e4a-44b2-a1f8-655f0d978cb9" returned: 0 in 0.336s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-64d237b7-0e4a-44b2-a1f8-655f0d978cb9" released by "delete_volume" :: held 1.004s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Created reservations ['65f075f4-01c8-421a-a9f4-6ba02343a6db', '448cecea-df28-40a2-8367-cf294bc76adb', '0756205a-483b-4d63-825b-479f1ac26677', '895f7652-98cb-42ca-9ef3-ef8fc0f57115'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:22 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:22 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:22 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.417s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:22 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:22 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Deleted volume successfully. Sep 28 15:16:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2eab2133-f816-4338-9e48-937520719e0e tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-64d237b7-0e4a-44b2-a1f8-655f0d978cb9-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-quobyte-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa" acquired by "delete_volume" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:23 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e68d43-bb82-4f55-b036-d17118deb603]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa Sep 28 15:16:23 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa" returned: 0 in 0.627s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa Sep 28 15:16:23 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa" returned: 0 in 0.505s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa" released by "delete_volume" :: held 1.202s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Created reservations ['c9f5a3c1-92a0-46ab-ab44-b1d2ff172f77', '20b25985-1d45-4b00-8c3f-eb38cd405137', 'c631b78b-0575-4449-8cd7-933dd40a975b', '8404a77b-4643-4c6a-b79f-a9685fbce117'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:24 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.385s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Deleted volume successfully. Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6da0c767-5ece-4ade-b384-b323f804fbf2 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-1ff3cd87-8f52-470f-9a71-4ffeb38d7aaa-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-e48f1120-0f39-4701-9266-95ba37f9a273-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-e48f1120-0f39-4701-9266-95ba37f9a273-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-quobyte-e48f1120-0f39-4701-9266-95ba37f9a273" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-e48f1120-0f39-4701-9266-95ba37f9a273" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c5288-9f13-44ca-a55b-a848988cc689]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 Sep 28 15:16:25 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273" returned: 0 in 0.826s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273 Sep 28 15:16:26 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e48f1120-0f39-4701-9266-95ba37f9a273" returned: 0 in 0.537s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-e48f1120-0f39-4701-9266-95ba37f9a273" released by "delete_volume" :: held 1.431s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Created reservations ['127cc72b-367e-4881-8813-51baa28ab729', '1d5cb793-aaac-4db9-bb99-fe3881954d22', '242d87ff-aa90-47cd-b658-92d795c2d2e2', '5d2ff4b8-8a08-4e73-955c-a4769561562c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:27 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.416s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:27 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Deleted volume successfully. Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d34b02a6-7b5d-4086-bd32-a5bde48c2716 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-e48f1120-0f39-4701-9266-95ba37f9a273-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-df1b5073-1571-46c8-bb63-e76b6e97ae07-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-df1b5073-1571-46c8-bb63-e76b6e97ae07-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-quobyte-df1b5073-1571-46c8-bb63-e76b6e97ae07" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-df1b5073-1571-46c8-bb63-e76b6e97ae07" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:28 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[880f1d23-3ca1-43d7-9013-0bdafcb86068]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 Sep 28 15:16:28 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:28 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07" returned: 0 in 0.754s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:29 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07 Sep 28 15:16:29 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-df1b5073-1571-46c8-bb63-e76b6e97ae07" returned: 0 in 0.551s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-df1b5073-1571-46c8-bb63-e76b6e97ae07" released by "delete_volume" :: held 1.403s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Created reservations ['1b91f0ea-fa48-44a9-9213-da5409b3c748', '743ad34f-fe1f-42b6-ad2b-c41fbb61723a', '7b549f01-799d-4f7f-a1d8-c507807fb9b6', '0b76f9f2-f409-483e-a5ae-34697ececefd'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:29 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:29 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:30 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Deleted volume successfully. Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2c32261d-0a28-4223-baca-cfe34d2dde9b tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-df1b5073-1571-46c8-bb63-e76b6e97ae07-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-1afca601-fa99-4855-8ba2-153083073382-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-1afca601-fa99-4855-8ba2-153083073382-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "cinder-quobyte-1afca601-fa99-4855-8ba2-153083073382" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-1afca601-fa99-4855-8ba2-153083073382" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689373c-78a9-4e27-ba81-b162be267684]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 Sep 28 15:16:30 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382" returned: 0 in 0.486s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382 Sep 28 15:16:31 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1afca601-fa99-4855-8ba2-153083073382" returned: 0 in 0.488s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-quobyte-1afca601-fa99-4855-8ba2-153083073382" released by "delete_volume" :: held 1.079s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Created reservations ['1e752171-a509-4be5-8ef2-a672fc08a5ad', '07bf21fd-473a-46e3-8c70-716f58c3c67f', '980d41b9-84cf-4b71-b36b-4bd3863d0cdf', 'bf004b44-2eb0-4d9e-9d0f-9db528ed26ed'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:31 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:32 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.276s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:32 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:32 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Deleted volume successfully. Sep 28 15:16:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-47c98b09-28a3-42a8-8da2-e367b210bf39 tempest-CreateVolumesFromImageTest-1680718606 None] Lock "cinder-1afca601-fa99-4855-8ba2-153083073382-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:33 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:34 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.567s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:16:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Flow 'volume_create_manager' (4a9975be-7bd4-4f71-9efa-b1f3ceaeeba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e6cbdd-4f9b-4eab-81f5-27e503ef4965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e6cbdd-4f9b-4eab-81f5-27e503ef4965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-148169930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b257627-10e4-4189-8a06-71e5a8e26d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6ea831b65c44e3bef8f8a8d3efb28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:35Z,use_quota=True,user_id='36cb5660cc2f43ae8727e07558f5f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be59cd89-ca52-435f-a54a-207eab7643ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be59cd89-ca52-435f-a54a-207eab7643ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac00e91-96f7-4fb6-a389-2af355331a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac00e91-96f7-4fb6-a389-2af355331a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b257627-10e4-4189-8a06-71e5a8e26d05', 'volume_name': 'volume-2b257627-10e4-4189-8a06-71e5a8e26d05', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6517b4d7-693b-41ae-8807-b33c53bdf0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6517b4d7-693b-41ae-8807-b33c53bdf0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23283ed2-b521-408c-ac4b-d173270bc75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Volume 2b257627-10e4-4189-8a06-71e5a8e26d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b257627-10e4-4189-8a06-71e5a8e26d05', 'volume_size': 1} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-148169930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b257627-10e4-4189-8a06-71e5a8e26d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6ea831b65c44e3bef8f8a8d3efb28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:35Z,use_quota=True,user_id='36cb5660cc2f43ae8727e07558f5f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Creating volume 2b257627-10e4-4189-8a06-71e5a8e26d05 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:35 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 1073741824 Sep 28 15:16:35 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:36 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 1073741824" returned: 0 in 0.907s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:36 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 Sep 28 15:16:36 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:37 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05" returned: 0 in 0.756s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23283ed2-b521-408c-ac4b-d173270bc75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b257627-10e4-4189-8a06-71e5a8e26d05', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a181e1b1-1a02-44cd-941f-e247220c5adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:37 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Volume volume-2b257627-10e4-4189-8a06-71e5a8e26d05 (2b257627-10e4-4189-8a06-71e5a8e26d05): created successfully Sep 28 15:16:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a181e1b1-1a02-44cd-941f-e247220c5adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Flow 'volume_create_manager' (4a9975be-7bd4-4f71-9efa-b1f3ceaeeba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:37 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9f2730bd-16ff-483e-8af1-892bf1271600 tempest-TestMinimumBasicScenario-1009850649 None] Created volume successfully. Sep 28 15:16:40 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Flow 'volume_create_manager' (5422fe45-d391-4722-91d3-954a1b755f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9e6e96-34c1-4479-b411-952832cd064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9e6e96-34c1-4479-b411-952832cd064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c542544-97ce-4624-8532-550712fea9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e17a3a82acc4564a3f23e3bdda57dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:41Z,use_quota=True,user_id='2a92c57483864fdc8da05a8718689691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205a7c8c-9247-49bc-b421-606cb4fc92f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205a7c8c-9247-49bc-b421-606cb4fc92f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc342d2d-cdb4-4abe-977f-91b30ef33735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc342d2d-cdb4-4abe-977f-91b30ef33735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c542544-97ce-4624-8532-550712fea9da', 'volume_name': 'volume-7c542544-97ce-4624-8532-550712fea9da', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c166beb5-9784-4e70-8c8c-dc791cfe1cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c166beb5-9784-4e70-8c8c-dc791cfe1cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef1659b-109e-488d-9b4a-f87deb6af835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Volume 7c542544-97ce-4624-8532-550712fea9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c542544-97ce-4624-8532-550712fea9da', 'volume_size': 1} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c542544-97ce-4624-8532-550712fea9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e17a3a82acc4564a3f23e3bdda57dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:41Z,use_quota=True,user_id='2a92c57483864fdc8da05a8718689691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Creating volume 7c542544-97ce-4624-8532-550712fea9da {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:41 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:41 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da 1073741824 Sep 28 15:16:41 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-bd74d126-221c-455a-82e1-fa02b49f2334 req-584d4732-192c-4530-837e-f70d2055edb0 tempest-TestMinimumBasicScenario-1009850649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:41 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da 1073741824" returned: 0 in 0.674s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:41 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da Sep 28 15:16:41 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:42 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da" returned: 0 in 0.347s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-bd74d126-221c-455a-82e1-fa02b49f2334 req-584d4732-192c-4530-837e-f70d2055edb0 tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.971s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef1659b-109e-488d-9b4a-f87deb6af835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c542544-97ce-4624-8532-550712fea9da', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fc40b8-80e5-400f-9613-9d6db63d32fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-bd74d126-221c-455a-82e1-fa02b49f2334 req-584d4732-192c-4530-837e-f70d2055edb0 tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.078s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Volume volume-7c542544-97ce-4624-8532-550712fea9da (7c542544-97ce-4624-8532-550712fea9da): created successfully Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fc40b8-80e5-400f-9613-9d6db63d32fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Flow 'volume_create_manager' (5422fe45-d391-4722-91d3-954a1b755f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-17a8be5e-ea93-45d2-b342-6c1a7cf696a0 tempest-CinderUnicodeTest-1246467989 None] Created volume successfully. Sep 28 15:16:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-bd74d126-221c-455a-82e1-fa02b49f2334 req-584d4732-192c-4530-837e-f70d2055edb0 tempest-TestMinimumBasicScenario-1009850649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-2b257627-10e4-4189-8a06-71e5a8e26d05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '509e688d-50a3-42da-bbd9-081c98a206ab', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:16:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-bd74d126-221c-455a-82e1-fa02b49f2334 req-584d4732-192c-4530-837e-f70d2055edb0 tempest-TestMinimumBasicScenario-1009850649 None] attachment_update completed successfully. Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Flow 'volume_create_manager' (82f62689-097c-435e-bb63-1a2845f74e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9aa9b6-3545-4923-9a99-f209bef365c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9aa9b6-3545-4923-9a99-f209bef365c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1577392559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4c39ce-0297-4176-8046-bcc8a45de74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e17a3a82acc4564a3f23e3bdda57dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:44Z,use_quota=True,user_id='2a92c57483864fdc8da05a8718689691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0412f054-851e-46d8-9564-fe3ba6b1ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0412f054-851e-46d8-9564-fe3ba6b1ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff37af51-7394-41ee-945f-8063b8b79ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff37af51-7394-41ee-945f-8063b8b79ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4c39ce-0297-4176-8046-bcc8a45de74e', 'volume_name': 'volume-0e4c39ce-0297-4176-8046-bcc8a45de74e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6a78e7-c40b-414b-9c91-07b3e3dd3440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6a78e7-c40b-414b-9c91-07b3e3dd3440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6fd4f1-6608-4da7-8618-e7aa9e548f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Volume 0e4c39ce-0297-4176-8046-bcc8a45de74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4c39ce-0297-4176-8046-bcc8a45de74e', 'volume_size': 1} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1577392559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4c39ce-0297-4176-8046-bcc8a45de74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e17a3a82acc4564a3f23e3bdda57dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:44Z,use_quota=True,user_id='2a92c57483864fdc8da05a8718689691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Creating volume 0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:44 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:44 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e 1073741824 Sep 28 15:16:44 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:45 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e 1073741824" returned: 0 in 0.706s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:45 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e Sep 28 15:16:45 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:45 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e" returned: 0 in 0.464s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6fd4f1-6608-4da7-8618-e7aa9e548f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4c39ce-0297-4176-8046-bcc8a45de74e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d7ab01-12ae-4e52-a702-a66e765695ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:45 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Volume volume-0e4c39ce-0297-4176-8046-bcc8a45de74e (0e4c39ce-0297-4176-8046-bcc8a45de74e): created successfully Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d7ab01-12ae-4e52-a702-a66e765695ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:45 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Flow 'volume_create_manager' (82f62689-097c-435e-bb63-1a2845f74e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7357d043-c713-47c7-9c9b-f9f6598eb353 tempest-CinderUnicodeTest-1246467989 None] Created volume successfully. Sep 28 15:16:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Creating offline snapshot 1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 of volume 0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bc8bd3-e64f-4d7d-af94-9bb0e95cfaf2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:46 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e Sep 28 15:16:46 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:46 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e" returned: 0 in 0.520s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:47 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 1G Sep 28 15:16:47 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:47 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 1G" returned: 0 in 0.805s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e4c39ce-0297-4176-8046-bcc8a45de74e -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:47 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e4c39ce-0297-4176-8046-bcc8a45de74e -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 Sep 28 15:16:47 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:48 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e4c39ce-0297-4176-8046-bcc8a45de74e -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" returned: 0 in 0.519s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:48 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 is being set with open permissions: ugo+rw Sep 28 15:16:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:48 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 Sep 28 15:16:48 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:48 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" returned: 0 in 0.531s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:48 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.info Sep 28 15:16:48 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:49 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.info" returned: 0 in 0.346s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:49 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.info is being set with open permissions: ugo+rw Sep 28 15:16:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:49 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.info Sep 28 15:16:49 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:49 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.info" returned: 0 in 0.331s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.232s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ff92c946-90a4-4e9b-b263-c13817d48f72 tempest-CinderUnicodeTest-1246467989 None] Create snapshot completed successfully Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (9129bf69-f42f-4762-b145-b8e00d752e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90a7634-9db0-4be5-9770-59cf47eb36e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90a7634-9db0-4be5-9770-59cf47eb36e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560377154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8a91b7-4681-4d82-806f-436f6a7ad231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:50Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6e3da9-89e2-4c55-9a2e-81da17533399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6e3da9-89e2-4c55-9a2e-81da17533399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff7376-3f61-40ad-84df-89036d46a974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff7376-3f61-40ad-84df-89036d46a974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f8a91b7-4681-4d82-806f-436f6a7ad231', 'volume_name': 'volume-8f8a91b7-4681-4d82-806f-436f6a7ad231', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a57ccd-bf4b-4212-adf5-bae8dfbc8f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a57ccd-bf4b-4212-adf5-bae8dfbc8f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc396413-41a3-45af-9030-d596c5a2f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:50 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume 8f8a91b7-4681-4d82-806f-436f6a7ad231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f8a91b7-4681-4d82-806f-436f6a7ad231', 'volume_size': 1} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560377154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8a91b7-4681-4d82-806f-436f6a7ad231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:50Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Creating volume 8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:50 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:50 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 1073741824 Sep 28 15:16:50 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "cinder-1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "cinder-quobyte-0e4c39ce-0297-4176-8046-bcc8a45de74e" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-0e4c39ce-0297-4176-8046-bcc8a45de74e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "cinder-quobyte-1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Deleting offline snapshot 1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 of volume 0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] snapshot_file for this snap is: volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb857b-3090-41b9-b34c-a4a753de7cdf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:51 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 Sep 28 15:16:51 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:51 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 1073741824" returned: 0 in 0.875s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:51 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 Sep 28 15:16:51 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:51 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" returned: 0 in 0.568s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e4c39ce-0297-4176-8046-bcc8a45de74e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7a4674-e5a2-4f21-865c-4b74b56c76bc]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:51 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231" returned: 0 in 0.415s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc396413-41a3-45af-9030-d596c5a2f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f8a91b7-4681-4d82-806f-436f6a7ad231', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641c556-b5c3-43d9-8264-011f7e16fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:52 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 (8f8a91b7-4681-4d82-806f-436f6a7ad231): created successfully Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641c556-b5c3-43d9-8264-011f7e16fd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (9129bf69-f42f-4762-b145-b8e00d752e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:52 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e Sep 28 15:16:52 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-510b2163-17c1-4365-9508-25979c0adbb8 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created volume successfully. Sep 28 15:16:52 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e" returned: 0 in 0.710s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:52 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 Sep 28 15:16:52 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Creating offline snapshot 95e0b9e1-b321-477b-9413-d25f5f5b1148 of volume 8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa52c0f1-fc0d-4087-ba21-88cb651b355b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:53 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 Sep 28 15:16:53 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:53 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" returned: 0 in 0.738s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:53 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3 Sep 28 15:16:53 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:53 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231" returned: 0 in 0.687s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:53 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 1G Sep 28 15:16:53 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:53 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e.1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" returned: 0 in 0.554s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3" released by "_delete_snapshot" :: held 2.807s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-0e4c39ce-0297-4176-8046-bcc8a45de74e" released by "delete_snapshot" :: held 2.857s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Created reservations ['3d0d656c-72cc-42a6-ae37-f998cb4a8d49', 'e5b5120a-851d-408f-9fd0-a6bc3535671c', 'd4f92c82-e096-4ed0-b012-f2da7b26294a', '53a9bc10-1c68-400c-b586-53a0e90402ae'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:54 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Delete snapshot completed successfully. Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d249a572-531b-4b0d-a58e-634ba352ca66 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-1bd85e6b-fa99-4f8e-b2e0-a5b02dfdaed3-delete_snapshot" released by "delete_snapshot" :: held 3.174s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "cinder-0e4c39ce-0297-4176-8046-bcc8a45de74e-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-0e4c39ce-0297-4176-8046-bcc8a45de74e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "cinder-quobyte-0e4c39ce-0297-4176-8046-bcc8a45de74e" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-0e4c39ce-0297-4176-8046-bcc8a45de74e" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:54 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 1G" returned: 0 in 0.955s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[3533543a-5ff0-48b1-bd91-15ac2a60c451]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:54 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 Sep 28 15:16:54 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:54 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e Sep 28 15:16:54 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:55 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148" returned: 0 in 0.404s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:55 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 is being set with open permissions: ugo+rw Sep 28 15:16:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:55 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 Sep 28 15:16:55 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:55 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e" returned: 0 in 0.653s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:55 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e Sep 28 15:16:55 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:55 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148" returned: 0 in 0.477s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:55 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.info Sep 28 15:16:55 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:56 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0e4c39ce-0297-4176-8046-bcc8a45de74e" returned: 0 in 0.641s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-0e4c39ce-0297-4176-8046-bcc8a45de74e" released by "delete_volume" :: held 1.446s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Created reservations ['9ebbc465-01c4-41bd-8760-25ff1e75c912', '93630767-034c-47ce-a469-97964d9b5e32', '92784dc6-52a3-4f99-9a62-d3fab49e4491', 'a2c0a402-3b12-44f2-b0d3-5f5464d2955d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:56 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.info" returned: 0 in 0.487s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:56 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.info is being set with open permissions: ugo+rw Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:56 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.info Sep 28 15:16:56 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:56 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:56 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:56 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.407s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:56 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.info" returned: 0 in 0.524s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.776s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Deleted volume successfully. Sep 28 15:16:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d0e1efbc-27c5-46e5-b655-5030608076d1 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Create snapshot completed successfully Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ddafe04-0639-442b-81da-a331ed85ac5c tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-0e4c39ce-0297-4176-8046-bcc8a45de74e-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "cinder-7c542544-97ce-4624-8532-550712fea9da-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-7c542544-97ce-4624-8532-550712fea9da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "cinder-quobyte-7c542544-97ce-4624-8532-550712fea9da" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-7c542544-97ce-4624-8532-550712fea9da" acquired by "delete_volume" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:57 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[13926ee4-d887-4288-b04d-cb92a3305138]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:57 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da Sep 28 15:16:57 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:57 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da" returned: 0 in 0.803s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:58 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da Sep 28 15:16:58 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (cec9fdf5-b638-4d83-880a-a89dd366c0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec1904d-b070-4972-a431-59eaeb45d5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec1904d-b070-4972-a431-59eaeb45d5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805026200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e76cf1-8355-46fd-8d33-7bbaa35c78ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:58Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2bd9c7-86e9-4858-b2cf-dccc93439061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2bd9c7-86e9-4858-b2cf-dccc93439061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0634145-b55b-4dd8-9729-d5d531a632f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0634145-b55b-4dd8-9729-d5d531a632f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e76cf1-8355-46fd-8d33-7bbaa35c78ad', 'volume_name': 'volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a660d7-6025-4ea2-bab0-8cab2ea0565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a660d7-6025-4ea2-bab0-8cab2ea0565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1de801-4357-4fc9-ba4b-09a9836fd03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume c6e76cf1-8355-46fd-8d33-7bbaa35c78ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad', 'volume_size': 1} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805026200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e76cf1-8355-46fd-8d33-7bbaa35c78ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:58Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Creating volume c6e76cf1-8355-46fd-8d33-7bbaa35c78ad {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:58 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:58 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad 1073741824 Sep 28 15:16:58 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:58 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7c542544-97ce-4624-8532-550712fea9da" returned: 0 in 0.750s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-quobyte-7c542544-97ce-4624-8532-550712fea9da" released by "delete_volume" :: held 1.649s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:58 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Created reservations ['08bb42bc-5afb-4558-82a9-73866e469f60', 'ee5f6954-43ab-4315-ab12-8a4e88c5a150', '7eb05083-5c3e-4230-97c1-3827cc1d4429', 'd37b049d-ba0d-4581-9555-0e4e5ce50244'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (176cd6ca-2b56-40e5-bdf1-e7da8438063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32b2b77-6565-41bf-ab72-1cd582f5a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:59 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad 1073741824" returned: 0 in 0.934s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32b2b77-6565-41bf-ab72-1cd582f5a634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-873516639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadcb282-3f6c-4bb6-9ecd-5ef007f7465f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:59Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:59 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:16:59 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7e0e2c-49c0-4b6a-b318-c401bfb27a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7e0e2c-49c0-4b6a-b318-c401bfb27a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cd9b31-2a79-4add-a093-2f720321dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cd9b31-2a79-4add-a093-2f720321dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cadcb282-3f6c-4bb6-9ecd-5ef007f7465f', 'volume_name': 'volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b545cf-b205-4b3b-8bd8-2b2c4a6518cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b545cf-b205-4b3b-8bd8-2b2c4a6518cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3a914e-d580-4b54-aaea-4e543890ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume cadcb282-3f6c-4bb6-9ecd-5ef007f7465f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f', 'volume_size': 1} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:59 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad Sep 28 15:16:59 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:59 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.489s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Deleted volume successfully. Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d09d9837-35fd-4906-bd28-3bf7f4b67690 tempest-CinderUnicodeTest-1246467989 None] Lock "cinder-7c542544-97ce-4624-8532-550712fea9da-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:59 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad" returned: 0 in 0.510s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-873516639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadcb282-3f6c-4bb6-9ecd-5ef007f7465f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:59Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Creating volume cadcb282-3f6c-4bb6-9ecd-5ef007f7465f {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:59 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:59 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f 1073741824 Sep 28 15:16:59 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1de801-4357-4fc9-ba4b-09a9836fd03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f986b-b181-426d-811c-b493990fd7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad (c6e76cf1-8355-46fd-8d33-7bbaa35c78ad): created successfully Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f986b-b181-426d-811c-b493990fd7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (cec9fdf5-b638-4d83-880a-a89dd366c0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3cb6772b-9f25-4612-ab70-a858d53cc0a0 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created volume successfully. Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (81761a94-caba-4718-ab10-2923c98d15b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb04b92-3e0c-448e-a819-d92ad2df9021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb04b92-3e0c-448e-a819-d92ad2df9021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425752089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb1ddec-0b3f-4d5a-8814-e67bbed3e290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:00Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7abd8ef-2719-44fa-8df3-f87120eab962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7abd8ef-2719-44fa-8df3-f87120eab962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b9efae-c246-4f50-9820-fb285cafe2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b9efae-c246-4f50-9820-fb285cafe2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb1ddec-0b3f-4d5a-8814-e67bbed3e290', 'volume_name': 'volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d54126a-eef8-4aaf-9fd2-09555a9242f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d54126a-eef8-4aaf-9fd2-09555a9242f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4616fae1-dfbe-42ad-8ecb-528ecfb5221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume 7cb1ddec-0b3f-4d5a-8814-e67bbed3e290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290', 'volume_size': 1} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:00 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f 1073741824" returned: 0 in 0.918s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=92,cinder:UPDATE=122,cinder:INSERT=25,cinder:DELETE=13 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:00 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f Sep 28 15:17:00 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (025fd9bc-eed7-4c68-a2dc-04a1b1377068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb68b68d-ea38-4610-955f-7fde873e2143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb68b68d-ea38-4610-955f-7fde873e2143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344787254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7230d41-7bb5-43d3-b977-40b45ec6083f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:01Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dacf57c-b5a0-46de-817c-4ceb4d07c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dacf57c-b5a0-46de-817c-4ceb4d07c282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a239b9-9f63-4247-94e1-1121b8d3d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a239b9-9f63-4247-94e1-1121b8d3d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7230d41-7bb5-43d3-b977-40b45ec6083f', 'volume_name': 'volume-e7230d41-7bb5-43d3-b977-40b45ec6083f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06999883-6403-4114-b4df-15bd79735e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06999883-6403-4114-b4df-15bd79735e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002bfbf8-54df-484c-8d3b-de560c3ec548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume e7230d41-7bb5-43d3-b977-40b45ec6083f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7230d41-7bb5-43d3-b977-40b45ec6083f', 'volume_size': 1} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:01 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f" returned: 0 in 0.424s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425752089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb1ddec-0b3f-4d5a-8814-e67bbed3e290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:00Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Creating volume 7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=117,cinder:SELECT=105,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3a914e-d580-4b54-aaea-4e543890ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cad730-bd4a-4164-9745-b7a0cd6fac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 1073741824 Sep 28 15:17:01 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f (cadcb282-3f6c-4bb6-9ecd-5ef007f7465f): created successfully Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cad730-bd4a-4164-9745-b7a0cd6fac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (176cd6ca-2b56-40e5-bdf1-e7da8438063c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4cf01a6a-1a4c-4958-a61e-3d2de2343f99 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created volume successfully. Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (03b259a1-bd19-4294-b5b2-b5e5c8f2bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d295e0-c4fd-4278-8666-ec74c986b24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d295e0-c4fd-4278-8666-ec74c986b24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319102348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2b70f-4d7f-4286-92db-84630a1026b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:02Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae1570a-fcb0-4977-9a8f-c8d1b8c58874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae1570a-fcb0-4977-9a8f-c8d1b8c58874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626f7b4f-e1ce-4563-8657-8815468110e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626f7b4f-e1ce-4563-8657-8815468110e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed2b70f-4d7f-4286-92db-84630a1026b4', 'volume_name': 'volume-9ed2b70f-4d7f-4286-92db-84630a1026b4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7456c2f-d659-49d6-b21e-b64fed29151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7456c2f-d659-49d6-b21e-b64fed29151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8309dbdb-a296-48f8-a4f3-f2edd454ca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume 9ed2b70f-4d7f-4286-92db-84630a1026b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed2b70f-4d7f-4286-92db-84630a1026b4', 'volume_size': 1} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:01 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 1073741824" returned: 0 in 0.707s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:02 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 Sep 28 15:17:02 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:02 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290" returned: 0 in 0.323s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344787254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7230d41-7bb5-43d3-b977-40b45ec6083f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:01Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Creating volume e7230d41-7bb5-43d3-b977-40b45ec6083f {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:02 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4616fae1-dfbe-42ad-8ecb-528ecfb5221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30f532-39b4-4550-9839-af9e5270db97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 (7cb1ddec-0b3f-4d5a-8814-e67bbed3e290): created successfully Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30f532-39b4-4550-9839-af9e5270db97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (81761a94-caba-4718-ab10-2923c98d15b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:02 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f 1073741824 Sep 28 15:17:02 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b60eee37-3bf6-4f7b-8435-39306fa168f5 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created volume successfully. Sep 28 15:17:03 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f 1073741824" returned: 0 in 0.820s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f Sep 28 15:17:03 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f" returned: 0 in 0.436s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-319102348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2b70f-4d7f-4286-92db-84630a1026b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea5cd02d5a74ec0a2b5e0f6574c9eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:02Z,use_quota=True,user_id='faa846b8b1264edd9fd8b02f8edc0b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Creating volume 9ed2b70f-4d7f-4286-92db-84630a1026b4 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:03 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002bfbf8-54df-484c-8d3b-de560c3ec548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7230d41-7bb5-43d3-b977-40b45ec6083f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:03 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 1073741824 Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3e1412-f7a1-4cb2-ad8f-aa84be444fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:03 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume volume-e7230d41-7bb5-43d3-b977-40b45ec6083f (e7230d41-7bb5-43d3-b977-40b45ec6083f): created successfully Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3e1412-f7a1-4cb2-ad8f-aa84be444fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (025fd9bc-eed7-4c68-a2dc-04a1b1377068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:03 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d1a443c5-005c-40dd-b97a-162ebb36ac56 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created volume successfully. Sep 28 15:17:04 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 1073741824" returned: 0 in 0.789s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:04 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 Sep 28 15:17:04 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:04 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4" returned: 0 in 0.357s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8309dbdb-a296-48f8-a4f3-f2edd454ca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed2b70f-4d7f-4286-92db-84630a1026b4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2b4b20-781b-434d-82ee-d6edbcd9c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Volume volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 (9ed2b70f-4d7f-4286-92db-84630a1026b4): created successfully Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2b4b20-781b-434d-82ee-d6edbcd9c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Flow 'volume_create_manager' (03b259a1-bd19-4294-b5b2-b5e5c8f2bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-001e2c11-a159-4c93-b2ad-98a99cdcbbdf tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created volume successfully. Sep 28 15:17:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-9ed2b70f-4d7f-4286-92db-84630a1026b4-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-9ed2b70f-4d7f-4286-92db-84630a1026b4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-9ed2b70f-4d7f-4286-92db-84630a1026b4" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-9ed2b70f-4d7f-4286-92db-84630a1026b4" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e390c704-f265-4f22-b4d2-c7d18f9f03ce]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:05 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 Sep 28 15:17:05 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:06 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Flow 'volume_create_manager' (8f26defe-5903-48ab-9220-6bcf22c9a48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d66110-442b-44ef-a2ab-175c2e4b2636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4" returned: 0 in 0.735s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d66110-442b-44ef-a2ab-175c2e4b2636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274677528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adddecbd-2f5d-45ea-b776-f30afc1f40fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d5449834a74aaf99336a8662e5a02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:06Z,use_quota=True,user_id='355beece90744364b84d52a77042ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4 Sep 28 15:17:06 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8a65ed-447b-4b4e-8f24-afe96ad7d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8a65ed-447b-4b4e-8f24-afe96ad7d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0e1066-2999-4003-a3e0-798d10def9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0e1066-2999-4003-a3e0-798d10def9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adddecbd-2f5d-45ea-b776-f30afc1f40fd', 'volume_name': 'volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d85632-6671-49e7-8ea1-d4ad26d065ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d85632-6671-49e7-8ea1-d4ad26d065ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93473c05-2b24-459d-a754-89dd536e2fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Volume adddecbd-2f5d-45ea-b776-f30afc1f40fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd', 'volume_size': 1} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274677528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adddecbd-2f5d-45ea-b776-f30afc1f40fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d5449834a74aaf99336a8662e5a02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:06Z,use_quota=True,user_id='355beece90744364b84d52a77042ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Creating volume adddecbd-2f5d-45ea-b776-f30afc1f40fd {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:06 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:06 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd 1073741824 Sep 28 15:17:06 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:06 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9ed2b70f-4d7f-4286-92db-84630a1026b4" returned: 0 in 0.315s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-9ed2b70f-4d7f-4286-92db-84630a1026b4" released by "delete_volume" :: held 1.119s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created reservations ['91fe8b15-13f5-47af-b912-38e19d484f81', '94536d1b-e968-40e5-901e-98afcd65706d', '10ab3062-bc2e-41e8-b2f5-ab082c5f72e7', '59fcdb84-3f06-474e-966d-5f3a6f6738bb'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:06 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:06 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:07 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd 1073741824" returned: 0 in 0.632s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:07 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd Sep 28 15:17:07 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:07 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.322s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:07 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Deleted volume successfully. Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e798c48c-72d3-46b6-8340-ce0f711355f4 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-9ed2b70f-4d7f-4286-92db-84630a1026b4-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:07 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd" returned: 0 in 0.336s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93473c05-2b24-459d-a754-89dd536e2fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5917df03-fbd3-4f3d-a417-826a2c98b826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Volume volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd (adddecbd-2f5d-45ea-b776-f30afc1f40fd): created successfully Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5917df03-fbd3-4f3d-a417-826a2c98b826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Flow 'volume_create_manager' (8f26defe-5903-48ab-9220-6bcf22c9a48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:07 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a002d39a-bf98-49c7-bc82-abb987c2f7df tempest-ProjectReaderTests-1911926798 None] Created volume successfully. Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-e7230d41-7bb5-43d3-b977-40b45ec6083f-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-e7230d41-7bb5-43d3-b977-40b45ec6083f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-e7230d41-7bb5-43d3-b977-40b45ec6083f" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-e7230d41-7bb5-43d3-b977-40b45ec6083f" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fad345-1adf-4520-928c-ab29eb6b706b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:08 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f Sep 28 15:17:08 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:08 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f" returned: 0 in 0.520s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:08 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f Sep 28 15:17:08 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Acquiring lock "cinder-adddecbd-2f5d-45ea-b776-f30afc1f40fd-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Lock "cinder-adddecbd-2f5d-45ea-b776-f30afc1f40fd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Acquiring lock "cinder-quobyte-adddecbd-2f5d-45ea-b776-f30afc1f40fd" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Lock "cinder-quobyte-adddecbd-2f5d-45ea-b776-f30afc1f40fd" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:08 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e7230d41-7bb5-43d3-b977-40b45ec6083f" returned: 0 in 0.518s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[32db0f4b-ab82-4a82-9eee-88bab293867d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-e7230d41-7bb5-43d3-b977-40b45ec6083f" released by "delete_volume" :: held 1.116s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:08 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created reservations ['8bdf65b1-3fcb-4d00-8e7f-34eb9f38b5ed', 'ab651f16-2291-4990-a3c7-9210ee5cf099', '23058b7b-9389-425f-8466-2ee7187d2a75', '9077c86d-2c99-4073-a36f-590fe8d158d0'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:09 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd Sep 28 15:17:09 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:09 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:09 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:09 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd" returned: 0 in 0.495s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:09 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:09 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd Sep 28 15:17:09 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.355s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Deleted volume successfully. Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9372059f-ba44-40cc-b742-dc58ae544497 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-e7230d41-7bb5-43d3-b977-40b45ec6083f-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:09 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-adddecbd-2f5d-45ea-b776-f30afc1f40fd" returned: 0 in 0.353s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Lock "cinder-quobyte-adddecbd-2f5d-45ea-b776-f30afc1f40fd" released by "delete_volume" :: held 0.913s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Created reservations ['3e5ce92b-9842-4272-86ee-f963a1739ee9', 'a5568288-47c8-4a66-9c54-e97e84092adf', 'e8fddf5a-f89c-4fc6-81b1-a095f4c39346', 'c338a034-4387-45a4-beab-8747348f1fff'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:10 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290" acquired by "delete_volume" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35c1ad7-a9b1-45b8-83e8-edcac6eb69f4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.393s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:10 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 Sep 28 15:17:10 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Deleted volume successfully. Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-003169ce-6604-4a70-9338-512bd0527eec tempest-ProjectReaderTests-1911926798 None] Lock "cinder-adddecbd-2f5d-45ea-b776-f30afc1f40fd-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:10 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290" returned: 0 in 0.466s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290 Sep 28 15:17:10 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:11 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290" returned: 0 in 0.315s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290" released by "delete_volume" :: held 0.866s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created reservations ['a499b14c-cbc6-4f45-acfb-c391ce394494', '031f9f66-6a0b-4f6f-9316-eb2dc7ef3d8f', '01530566-15a6-4f50-9cfe-bbc735d7260f', 'df3843b9-c77c-4641-9a29-a08c279dfd35'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:11 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:11 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.443s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Deleted volume successfully. Sep 28 15:17:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5bddb410-992d-4ca4-bad8-90a331ad124d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-7cb1ddec-0b3f-4d5a-8814-e67bbed3e290-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Flow 'volume_create_manager' (414cbdab-df1a-4f96-8ae6-9ca2c5bbbd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20a60c5-5615-4f15-8cd6-aee36bbf9b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20a60c5-5615-4f15-8cd6-aee36bbf9b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989451559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7965fe-e1af-40c5-8d16-e5e0d5b41d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d5449834a74aaf99336a8662e5a02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:12Z,use_quota=True,user_id='355beece90744364b84d52a77042ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632fd734-902e-49e3-886b-42d1e63c1a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632fd734-902e-49e3-886b-42d1e63c1a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97033a3e-7f90-44e6-8dec-574a0a8e0f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97033a3e-7f90-44e6-8dec-574a0a8e0f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7965fe-e1af-40c5-8d16-e5e0d5b41d80', 'volume_name': 'volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2536002e-076e-4110-a49d-fe77954eaffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2536002e-076e-4110-a49d-fe77954eaffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f1d14b-cbda-4237-b8e8-15c448e138e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Volume 4d7965fe-e1af-40c5-8d16-e5e0d5b41d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80', 'volume_size': 1} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989451559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7965fe-e1af-40c5-8d16-e5e0d5b41d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d5449834a74aaf99336a8662e5a02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:12Z,use_quota=True,user_id='355beece90744364b84d52a77042ab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Creating volume 4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:12 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:12 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 1073741824 Sep 28 15:17:12 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e11ec-4818-472e-aa23-d7b79fd203c3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:12 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f Sep 28 15:17:12 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 1073741824" returned: 0 in 0.832s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 Sep 28 15:17:13 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:13 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80" returned: 0 in 0.479s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:13 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f1d14b-cbda-4237-b8e8-15c448e138e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1fdd22-f89f-429a-83b9-ea558098e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f" returned: 0 in 1.082s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Volume volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 (4d7965fe-e1af-40c5-8d16-e5e0d5b41d80): created successfully Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1fdd22-f89f-429a-83b9-ea558098e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:13 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Flow 'volume_create_manager' (414cbdab-df1a-4f96-8ae6-9ca2c5bbbd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:13 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f Sep 28 15:17:13 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:13 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9f2dca62-d185-4d71-bf16-7d87aba70870 tempest-ProjectReaderTests-1911926798 None] Created volume successfully. Sep 28 15:17:14 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f" returned: 0 in 0.449s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f" released by "delete_volume" :: held 1.611s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created reservations ['96411572-a721-41ae-89ca-b308ad4e6c5f', '2c102ff4-095a-49ae-959e-24c7ab3011d9', '7477d843-7e90-4a1d-962e-a60a1ddd08df', '7370d85c-9763-4f27-9529-ee35ff34dc12'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Acquiring lock "cinder-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Lock "cinder-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:14 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:14 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Acquiring lock "cinder-quobyte-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Lock "cinder-quobyte-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde40267-7df7-4f44-91d6-9c7a270211cc]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:14 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 Sep 28 15:17:14 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:14 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.385s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Deleted volume successfully. Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b48e84df-0e3e-4834-8c1f-971a076881bc tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-cadcb282-3f6c-4bb6-9ecd-5ef007f7465f-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e699d12-f803-4ed6-a80d-c9478555dcb0]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80" returned: 0 in 0.567s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80 Sep 28 15:17:15 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:15 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad Sep 28 15:17:15 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:15 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80" returned: 0 in 0.439s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Lock "cinder-quobyte-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80" released by "delete_volume" :: held 1.083s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Created reservations ['c2034f38-b82e-4760-9e89-11c97e503826', 'e2aac583-322c-40e1-a789-21c2066b2d8b', '123f5546-2ea7-45dc-addd-137cba271b84', '54dc9945-1d63-48d9-a452-5430e4315e86'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:15 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad" returned: 0 in 0.603s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad Sep 28 15:17:15 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:15 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:15 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad" returned: 0 in 0.318s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad" released by "delete_volume" :: held 1.008s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created reservations ['52ba7a0c-3479-40ab-804f-e888e60517df', '98a8e629-d05d-462c-a50c-6dbc35961a46', 'f455d3fe-61be-4457-b317-d3defa215fd8', '90aa4174-ba99-4206-8da1-94e77c92dea0'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:16 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.399s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Deleted volume successfully. Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-258d060b-1f13-4563-b877-af2b8405e62d tempest-ProjectReaderTests-1911926798 None] Lock "cinder-4d7965fe-e1af-40c5-8d16-e5e0d5b41d80-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:16 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:16 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:16 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.452s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Deleted volume successfully. Sep 28 15:17:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0398c5f9-2cba-447a-a601-fe649636bd1d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-c6e76cf1-8355-46fd-8d33-7bbaa35c78ad-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-95e0b9e1-b321-477b-9413-d25f5f5b1148-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-95e0b9e1-b321-477b-9413-d25f5f5b1148-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-8f8a91b7-4681-4d82-806f-436f6a7ad231" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-8f8a91b7-4681-4d82-806f-436f6a7ad231" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-95e0b9e1-b321-477b-9413-d25f5f5b1148" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-95e0b9e1-b321-477b-9413-d25f5f5b1148" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Deleting offline snapshot 95e0b9e1-b321-477b-9413-d25f5f5b1148 of volume 8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] snapshot_file for this snap is: volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6836f3c-9637-4d21-bcf6-4e520ba4d4a9]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:17 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 Sep 28 15:17:17 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:18 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148" returned: 0 in 0.834s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f8a91b7-4681-4d82-806f-436f6a7ad231(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13efefd-b7dc-4d69-994a-2e81f89497f3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:18 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 Sep 28 15:17:18 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:19 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231" returned: 0 in 0.919s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:19 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 Sep 28 15:17:19 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:20 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148" returned: 0 in 0.813s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148 Sep 28 15:17:20 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:20 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231.95e0b9e1-b321-477b-9413-d25f5f5b1148" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-95e0b9e1-b321-477b-9413-d25f5f5b1148" released by "_delete_snapshot" :: held 3.232s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-8f8a91b7-4681-4d82-806f-436f6a7ad231" released by "delete_snapshot" :: held 3.274s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created reservations ['7c748fb7-8cae-4d3d-bedb-18ed66bcdf07', 'e26399ab-b091-4f0b-b41c-e2c137ed6eac', '1cb82c0e-f2dc-4f90-abd3-4a9801fd29aa', '7a30aa56-1e1f-4c4c-8a0f-19b9b1e83b18'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Delete snapshot completed successfully. Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fe5134b6-b667-4020-a277-9b7ecb8bb73d tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-95e0b9e1-b321-477b-9413-d25f5f5b1148-delete_snapshot" released by "delete_snapshot" :: held 3.673s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Flow 'volume_create_manager' (a79c64a5-4c42-4d26-bf6b-1984e487a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75a6413-9c63-470c-bf19-da641794fc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75a6413-9c63-470c-bf19-da641794fc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1488633722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f074d0-b263-4ca3-8f3f-e06366669014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a49ad6182d4768b52b00b1c0a042a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:21Z,use_quota=True,user_id='3d9c906cd6ee432dade94c0cdab66163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4509859e-ee33-4a0a-8279-1ec8d53cc516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4509859e-ee33-4a0a-8279-1ec8d53cc516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf18db9-4dd5-455d-851b-2b835792dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf18db9-4dd5-455d-851b-2b835792dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f074d0-b263-4ca3-8f3f-e06366669014', 'volume_name': 'volume-e5f074d0-b263-4ca3-8f3f-e06366669014', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34a2457-24c7-4d63-bae2-6b9c081a7eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34a2457-24c7-4d63-bae2-6b9c081a7eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385cbcb1-4a94-4e26-9fc3-74d4a3930391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:21 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Volume e5f074d0-b263-4ca3-8f3f-e06366669014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f074d0-b263-4ca3-8f3f-e06366669014', 'volume_size': 1} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1488633722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f074d0-b263-4ca3-8f3f-e06366669014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a49ad6182d4768b52b00b1c0a042a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:21Z,use_quota=True,user_id='3d9c906cd6ee432dade94c0cdab66163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Creating volume e5f074d0-b263-4ca3-8f3f-e06366669014 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:21 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 1073741824 Sep 28 15:17:21 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 1073741824" returned: 0 in 0.545s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 Sep 28 15:17:21 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-8f8a91b7-4681-4d82-806f-436f6a7ad231-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-8f8a91b7-4681-4d82-806f-436f6a7ad231-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "cinder-quobyte-8f8a91b7-4681-4d82-806f-436f6a7ad231" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-8f8a91b7-4681-4d82-806f-436f6a7ad231" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec2283-cfe2-489e-9128-ef4c5d8c101d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:22 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:22 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 Sep 28 15:17:22 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014" returned: 0 in 0.402s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385cbcb1-4a94-4e26-9fc3-74d4a3930391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f074d0-b263-4ca3-8f3f-e06366669014', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2786e1a4-6722-443a-b2e0-4502d2080adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:22 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Volume volume-e5f074d0-b263-4ca3-8f3f-e06366669014 (e5f074d0-b263-4ca3-8f3f-e06366669014): created successfully Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2786e1a4-6722-443a-b2e0-4502d2080adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Flow 'volume_create_manager' (a79c64a5-4c42-4d26-bf6b-1984e487a890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:22 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8c7d4003-6c30-41cb-b6ae-a25ca6fe5383 tempest-TestImageHashVerification-1100135265 None] Created volume successfully. Sep 28 15:17:22 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231" returned: 0 in 0.412s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:22 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231 Sep 28 15:17:22 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:22 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8f8a91b7-4681-4d82-806f-436f6a7ad231" returned: 0 in 0.277s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-quobyte-8f8a91b7-4681-4d82-806f-436f6a7ad231" released by "delete_volume" :: held 0.772s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Created reservations ['d533588e-56dc-458b-a5ad-c59c970dfe9c', '8ee1fc76-cc8b-40b1-8700-e1b75e715c5e', '05703993-fb19-4d56-a1b6-b432ac9186a1', '1bc90a90-c938-44f0-866e-69f53e2e71d1'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:22 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:22 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:23 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.359s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:23 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Deleted volume successfully. Sep 28 15:17:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-35dbed56-3951-49d4-a17f-668ff674fc00 tempest-CreateVolumesFromSnapshotTest-1749885222 None] Lock "cinder-8f8a91b7-4681-4d82-806f-436f6a7ad231-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:24 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cc9e79-b763-4d56-b241-4ae5aa5e45b6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:25 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 Sep 28 15:17:25 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:25 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014" returned: 0 in 0.424s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd9a039-ff9b-4737-806e-179a7458239e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:25 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 Sep 28 15:17:25 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:25 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014" returned: 0 in 0.474s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 /opt/stack/data/cinder/conversion/e5f074d0-b263-4ca3-8f3f-e06366669014.temp_image.e376a092-17cf-42b8-9aea-55d2cf5cbec98hz08rd4.img {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:25 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 /opt/stack/data/cinder/conversion/e5f074d0-b263-4ca3-8f3f-e06366669014.temp_image.e376a092-17cf-42b8-9aea-55d2cf5cbec98hz08rd4.img Sep 28 15:17:25 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:32 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=60,cinder:UPDATE=86,cinder:DELETE=5,cinder:INSERT=25 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:33 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:17:33 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:34 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.475s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:17:34 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 /opt/stack/data/cinder/conversion/e5f074d0-b263-4ca3-8f3f-e06366669014.temp_image.e376a092-17cf-42b8-9aea-55d2cf5cbec98hz08rd4.img" returned: 0 in 8.873s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c95395-19bd-412a-b920-e1bc6807dbf0]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:34 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 Sep 28 15:17:34 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:34 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=90,cinder:SELECT=53,cinder:DELETE=10,cinder:INSERT=17 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:35 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014" returned: 0 in 0.683s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:35 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/conversion/e5f074d0-b263-4ca3-8f3f-e06366669014.temp_image.e376a092-17cf-42b8-9aea-55d2cf5cbec98hz08rd4.img {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:17:35 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Converted 1024.00 MB image at 115.40 MB/s Sep 28 15:17:35 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] e376a092-17cf-42b8-9aea-55d2cf5cbec9 was raw, no need to convert to raw {{(pid=86384) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:17:43 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (6fb23f72-e0ef-49dd-888f-a7af0669575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b71bbe2-b023-4900-bd6a-61c5da3ff155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b71bbe2-b023-4900-bd6a-61c5da3ff155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-807620256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:44Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac036291-3471-4ddb-ab01-257a43b9dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac036291-3471-4ddb-ab01-257a43b9dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8232878-06be-4020-a780-501f85e5f2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8232878-06be-4020-a780-501f85e5f2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1', 'volume_name': 'volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a659a68-fb99-4b19-8423-86869b649ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a659a68-fb99-4b19-8423-86869b649ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb2aa79-f8d0-44df-9817-0597c85e4a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Volume b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1', 'volume_size': 1} Sep 28 15:17:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:53 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:54 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=3 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.212s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Uploaded volume to glance image-id: e376a092-17cf-42b8-9aea-55d2cf5cbec9. {{(pid=86384) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.979s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-807620256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:44Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Creating volume b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:57 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:57 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 1073741824 Sep 28 15:17:57 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9d3e87e5-9219-4096-8992-3afda66bf433 tempest-TestImageHashVerification-1100135265 None] Copy volume to image completed successfully. Sep 28 15:17:57 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:57 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 1073741824" returned: 0 in 0.682s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:57 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 Sep 28 15:17:57 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:58 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1" returned: 0 in 0.387s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb2aa79-f8d0-44df-9817-0597c85e4a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7681377a-b93d-45ec-b40d-cb5f417495f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Volume volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 (b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1): created successfully Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7681377a-b93d-45ec-b40d-cb5f417495f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (6fb23f72-e0ef-49dd-888f-a7af0669575e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-723e6bcb-5a48-4cb7-b992-03eea7440380 tempest-ProjectReaderTests-1697282386 None] Created volume successfully. Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Acquiring lock "cinder-e5f074d0-b263-4ca3-8f3f-e06366669014-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Lock "cinder-e5f074d0-b263-4ca3-8f3f-e06366669014-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Acquiring lock "cinder-quobyte-e5f074d0-b263-4ca3-8f3f-e06366669014" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Lock "cinder-quobyte-e5f074d0-b263-4ca3-8f3f-e06366669014" acquired by "delete_volume" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181f2d4-3943-40e6-81c4-eb647b541246]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:58 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 Sep 28 15:17:58 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:59 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014" returned: 0 in 0.570s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:59 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014 Sep 28 15:17:59 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-quobyte-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:59 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e5f074d0-b263-4ca3-8f3f-e06366669014" returned: 0 in 0.572s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c6f81-90c2-447d-af44-c64eac4ccd6d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Lock "cinder-quobyte-e5f074d0-b263-4ca3-8f3f-e06366669014" released by "delete_volume" :: held 1.245s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-eb08cd66-129a-42fe-8091-bf4e0c0aaf4b req-f3e1c743-a32b-41b9-bf3d-5e9695138bc4 tempest-TestMinimumBasicScenario-1009850649 None] Terminate volume connection completed successfully. Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-eb08cd66-129a-42fe-8091-bf4e0c0aaf4b req-f3e1c743-a32b-41b9-bf3d-5e9695138bc4 tempest-TestMinimumBasicScenario-1009850649 None] Deleting attachment 509e688d-50a3-42da-bbd9-081c98a206ab. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:59 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 Sep 28 15:17:59 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:59 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Created reservations ['dc46d8b1-1a44-4137-96e8-45ec14444792', '78ae8a28-3a60-4134-a2ab-cc2c9ebfec2a', '2c7d7e5a-de10-47e1-8255-15e004c011a1', '41106c5e-5cb4-4459-8f1f-c582fcedc680'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:00 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1" returned: 0 in 0.473s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1 Sep 28 15:18:00 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.390s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Deleted volume successfully. Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-58ca9d38-8a0d-45e8-b3a2-7efec2179959 tempest-TestImageHashVerification-1100135265 None] Lock "cinder-e5f074d0-b263-4ca3-8f3f-e06366669014-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:00 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1" returned: 0 in 0.331s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1" released by "delete_volume" :: held 0.875s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Acquiring lock "cinder-2b257627-10e4-4189-8a06-71e5a8e26d05-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Lock "cinder-2b257627-10e4-4189-8a06-71e5a8e26d05-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Created reservations ['63bedba3-5a29-49e2-887b-8ab3d477f5cd', 'a14f7624-5909-4f0a-b657-2458e41413d9', '855251f8-15d2-4fe0-9a8d-294fa25ea2f8', 'a4fac8d8-b333-4afd-9ae0-04d4df557a85'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Acquiring lock "cinder-quobyte-2b257627-10e4-4189-8a06-71e5a8e26d05" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Lock "cinder-quobyte-2b257627-10e4-4189-8a06-71e5a8e26d05" acquired by "delete_volume" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cacc17-d474-4439-8bc5-9f4bd59e5def]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:00 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 Sep 28 15:18:00 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:01 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.286s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Deleted volume successfully. Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fee11b54-360f-4a3e-9989-648949843395 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-b7418f1e-1c36-42ed-b5c6-2ee8a78c21c1-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:01 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05" returned: 0 in 0.432s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:01 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05 Sep 28 15:18:01 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:01 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2b257627-10e4-4189-8a06-71e5a8e26d05" returned: 0 in 0.282s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Lock "cinder-quobyte-2b257627-10e4-4189-8a06-71e5a8e26d05" released by "delete_volume" :: held 0.801s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Created reservations ['6b47ea08-ab7a-4e49-aab3-3faf96ce33f0', 'a99f656d-b862-476f-8c5c-09827023c26d', '8a464a55-5f11-4f35-b2d1-f001ea74cc19', '1419ff83-39ac-4b18-9bb4-a84a250ba5e3'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:01 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:01 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:02 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Deleted volume successfully. Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d9551227-23b0-42ee-8c70-31e74795697a tempest-TestMinimumBasicScenario-1009850649 None] Lock "cinder-2b257627-10e4-4189-8a06-71e5a8e26d05-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (66dc45df-dd0c-418d-8fdd-baa829d760e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c4cc8-1096-483d-b8d8-50fcda16cd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c4cc8-1096-483d-b8d8-50fcda16cd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913276714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0634e7f5-b37e-4aa3-88d5-d332c47de109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:03Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed52f22-3931-4e26-8c31-da279a681f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed52f22-3931-4e26-8c31-da279a681f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1de4650-d468-4a3b-8cdb-c0a215535d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1de4650-d468-4a3b-8cdb-c0a215535d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0634e7f5-b37e-4aa3-88d5-d332c47de109', 'volume_name': 'volume-0634e7f5-b37e-4aa3-88d5-d332c47de109', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bcaad5-1440-46cf-9a2e-d6ed2e158cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bcaad5-1440-46cf-9a2e-d6ed2e158cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d060ccf7-283c-4f24-8876-3f64dc8bc54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Volume 0634e7f5-b37e-4aa3-88d5-d332c47de109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0634e7f5-b37e-4aa3-88d5-d332c47de109', 'volume_size': 1} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913276714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0634e7f5-b37e-4aa3-88d5-d332c47de109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:03Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Creating volume 0634e7f5-b37e-4aa3-88d5-d332c47de109 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:02 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:18:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:02 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 1073741824 Sep 28 15:18:02 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:03 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 1073741824" returned: 0 in 0.651s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:03 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 Sep 28 15:18:03 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:04 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109" returned: 0 in 0.475s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d060ccf7-283c-4f24-8876-3f64dc8bc54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0634e7f5-b37e-4aa3-88d5-d332c47de109', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb809918-5281-407d-86ac-c9347c8c498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Volume volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 (0634e7f5-b37e-4aa3-88d5-d332c47de109): created successfully Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb809918-5281-407d-86ac-c9347c8c498e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (66dc45df-dd0c-418d-8fdd-baa829d760e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d7628cb8-317b-4a64-aaca-65b131522586 tempest-ProjectReaderTests-1697282386 None] Created volume successfully. Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-0634e7f5-b37e-4aa3-88d5-d332c47de109-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-0634e7f5-b37e-4aa3-88d5-d332c47de109-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-quobyte-0634e7f5-b37e-4aa3-88d5-d332c47de109" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-0634e7f5-b37e-4aa3-88d5-d332c47de109" acquired by "delete_volume" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[47801213-8a34-42e0-9b76-dd462aaa9c25]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 Sep 28 15:18:05 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:05 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109" returned: 0 in 0.467s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109 Sep 28 15:18:05 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:05 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-0634e7f5-b37e-4aa3-88d5-d332c47de109" returned: 0 in 0.323s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-0634e7f5-b37e-4aa3-88d5-d332c47de109" released by "delete_volume" :: held 0.848s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Created reservations ['80f4dbf7-04bc-4569-8f6c-295b5b6b24fc', '93da8489-2076-43f3-a73a-2c97628c0341', '15048f1b-c629-4b77-8e1b-4846e787ff8a', 'ae696784-5cfb-4734-b09d-a2c7750e39df'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:05 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:06 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.327s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Deleted volume successfully. Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c29f305d-3f03-439f-b1bd-d6d8901f1597 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-0634e7f5-b37e-4aa3-88d5-d332c47de109-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (480c95fd-f1cb-49a3-98a9-27d2794ef650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1cc76-6e0e-443e-a489-d9c7be7d526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1cc76-6e0e-443e-a489-d9c7be7d526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779238537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a2240a-c151-46e2-8241-e417600b22b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:07Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cca800-050a-4fb3-a180-150ef99cee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cca800-050a-4fb3-a180-150ef99cee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0ea595-8787-494d-9a5e-cb517067c790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0ea595-8787-494d-9a5e-cb517067c790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a2240a-c151-46e2-8241-e417600b22b1', 'volume_name': 'volume-b2a2240a-c151-46e2-8241-e417600b22b1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7303d9-b638-452e-872b-5e19678f44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7303d9-b638-452e-872b-5e19678f44fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ebade1-f120-4a0a-89af-901d5b17c741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Volume b2a2240a-c151-46e2-8241-e417600b22b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a2240a-c151-46e2-8241-e417600b22b1', 'volume_size': 1} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779238537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a2240a-c151-46e2-8241-e417600b22b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:07Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Creating volume b2a2240a-c151-46e2-8241-e417600b22b1 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:06 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:18:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:06 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 1073741824 Sep 28 15:18:06 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:07 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 1073741824" returned: 0 in 0.571s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:07 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 Sep 28 15:18:07 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:07 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1" returned: 0 in 0.468s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ebade1-f120-4a0a-89af-901d5b17c741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a2240a-c151-46e2-8241-e417600b22b1', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8313d8a2-9cf2-4f05-9ffd-22939bf729af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Volume volume-b2a2240a-c151-46e2-8241-e417600b22b1 (b2a2240a-c151-46e2-8241-e417600b22b1): created successfully Sep 28 15:18:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8313d8a2-9cf2-4f05-9ffd-22939bf729af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (480c95fd-f1cb-49a3-98a9-27d2794ef650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8961f2c4-79a0-4a09-a171-7ce593f02bb9 tempest-ProjectReaderTests-1697282386 None] Created volume successfully. Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-b2a2240a-c151-46e2-8241-e417600b22b1-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Lock "cinder-b2a2240a-c151-46e2-8241-e417600b22b1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-quobyte-b2a2240a-c151-46e2-8241-e417600b22b1" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-b2a2240a-c151-46e2-8241-e417600b22b1" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f19b903-13cb-473b-ad8e-0d707472aa98]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 Sep 28 15:18:09 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1" returned: 0 in 0.496s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1 Sep 28 15:18:09 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:10 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b2a2240a-c151-46e2-8241-e417600b22b1" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-b2a2240a-c151-46e2-8241-e417600b22b1" released by "delete_volume" :: held 0.906s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Created reservations ['3b5aa3d6-69eb-4a35-8737-7033a0efed73', 'd7919ab4-9f69-4622-bbd7-5bcfef6dda8a', '1b85cae4-1b01-48c5-9c7c-ad368639f678', '7dc15a29-e07f-43c5-8124-3b4c02f1d07f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:10 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:10 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:10 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.342s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Deleted volume successfully. Sep 28 15:18:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fdd9d8a3-a8b9-4b32-befe-b970e4f118aa tempest-ProjectReaderTests-1697282386 None] Lock "cinder-b2a2240a-c151-46e2-8241-e417600b22b1-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (1d05c6ca-7245-4e0d-a87a-dbcc4729f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a579ead-e04d-4cea-89c9-9721b7624739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a579ead-e04d-4cea-89c9-9721b7624739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269118276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a98f454-a236-461c-9cfd-8e350645be7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a98f454-a236-461c-9cfd-8e350645be7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8007336-7850-44b0-8360-0fe8e630cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8007336-7850-44b0-8360-0fe8e630cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8', 'volume_name': 'volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c3da28-e23e-4d85-a47a-c2234a064f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c3da28-e23e-4d85-a47a-c2234a064f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7282a41-72f6-4a4d-bc87-b3e4370c5536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Volume b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8', 'volume_size': 1} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269118276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bec42a92e34ab3b0c60982c3cf52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='f4e248ce56cf4c47a4d9be9412a52f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Creating volume b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:11 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:11 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 1073741824 Sep 28 15:18:11 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:11 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 1073741824" returned: 0 in 0.527s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:11 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 Sep 28 15:18:11 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:12 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8" returned: 0 in 0.334s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7282a41-72f6-4a4d-bc87-b3e4370c5536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8f5b90-878c-4d8e-91ea-ce3de3b1456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Volume volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 (b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8): created successfully Sep 28 15:18:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8f5b90-878c-4d8e-91ea-ce3de3b1456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Flow 'volume_create_manager' (1d05c6ca-7245-4e0d-a87a-dbcc4729f979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-332dadf2-c10e-49bf-aa40-1aa961c9b40c tempest-ProjectReaderTests-1697282386 None] Created volume successfully. Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "cinder-quobyte-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8" acquired by "delete_volume" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708d2b8-d434-4396-b7a6-fdff8625808d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 Sep 28 15:18:13 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:13 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8" returned: 0 in 0.477s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8 Sep 28 15:18:13 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8" returned: 0 in 0.259s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-quobyte-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8" released by "delete_volume" :: held 0.803s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Created reservations ['90ed64d1-a580-448b-ba71-1e2d166f107d', '0a298663-8f3f-470e-988b-d483ce6c3171', '3eff3e4e-b60d-47ce-9242-ce49d1647a48', '0d5c255b-e851-4579-9c9e-9705667bf8a7'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:14 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:14 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.373s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Deleted volume successfully. Sep 28 15:18:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-adb01cb7-6a71-43df-ba49-46600e7d2f04 tempest-ProjectReaderTests-1697282386 None] Lock "cinder-b4c3f0cf-3b27-4f7f-95b1-8dd2423627d8-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Flow 'volume_create_manager' (2b970ed9-24eb-47d2-9bfc-b4516deca3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d102d57f-e1fb-4ee9-beb7-86bd583c07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d102d57f-e1fb-4ee9-beb7-86bd583c07d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f3d091-1039-44f2-9482-b74e406ffbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c82802254484e7baf2244b76a8774e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:23Z,use_quota=True,user_id='8599cc1b87c94c4eaaaeac15384dd079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(804ec365-90e3-4344-b55c-627d872c5f48),volume_type_id=804ec365-90e3-4344-b55c-627d872c5f48)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d123d-68f1-4bd7-a92a-832945676270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66d123d-68f1-4bd7-a92a-832945676270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5baf7d4c-92b1-4c34-8f6c-e36cef98703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5baf7d4c-92b1-4c34-8f6c-e36cef98703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '28f3d091-1039-44f2-9482-b74e406ffbf9', 'volume_name': 'volume-28f3d091-1039-44f2-9482-b74e406ffbf9', 'volume_size': 1, 'image_id': '174f0cd3-e959-40b4-82c9-9fd323992b5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/174f0cd3-e959-40b4-82c9-9fd323992b5d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f38097f0b4e10a180b73b53c93b10d21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c82802254484e7baf2244b76a8774e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '699f6085e87852d242511ace803c7b3912820c1226867e7e23fabb15a59d9c4aeb016aae455aa1531ab0c9c9c65b4711747e2698665f7f47d8689f7463d01a36', 'id': '174f0cd3-e959-40b4-82c9-9fd323992b5d', 'created_at': datetime.datetime(2026, 9, 28, 13, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 18, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/174f0cd3-e959-40b4-82c9-9fd323992b5d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e75dbf2-c1a6-4386-ab21-f4eb41f5c3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e75dbf2-c1a6-4386-ab21-f4eb41f5c3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8744d8cc-4c38-4c0b-9b6d-1368495c235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:23 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Volume 28f3d091-1039-44f2-9482-b74e406ffbf9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-28f3d091-1039-44f2-9482-b74e406ffbf9', 'volume_size': 1, 'image_id': '174f0cd3-e959-40b4-82c9-9fd323992b5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/174f0cd3-e959-40b4-82c9-9fd323992b5d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f38097f0b4e10a180b73b53c93b10d21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c82802254484e7baf2244b76a8774e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '699f6085e87852d242511ace803c7b3912820c1226867e7e23fabb15a59d9c4aeb016aae455aa1531ab0c9c9c65b4711747e2698665f7f47d8689f7463d01a36', 'id': '174f0cd3-e959-40b4-82c9-9fd323992b5d', 'created_at': datetime.datetime(2026, 9, 28, 13, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 18, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/174f0cd3-e959-40b4-82c9-9fd323992b5d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Trying to clone 28f3d091-1039-44f2-9482-b74e406ffbf9 from image 174f0cd3-e959-40b4-82c9-9fd323992b5d at location (None, [{'url': 'file:///opt/stack/data/glance/images/174f0cd3-e959-40b4-82c9-9fd323992b5d', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:18:23 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[354d6f3e-cdb7-446d-bb61-1ff8d6669903]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:23 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD Sep 28 15:18:23 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:24 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:24 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD Sep 28 15:18:24 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:24 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:24 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Temporary image 174f0cd3-e959-40b4-82c9-9fd323992b5d is fetched for user 8599cc1b87c94c4eaaaeac15384dd079. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:18:24 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[898abaec-a387-4cdf-845d-321076106472]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:24 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD Sep 28 15:18:24 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:25 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:25 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD Sep 28 15:18:25 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:25 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f3d091-1039-44f2-9482-b74e406ffbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c82802254484e7baf2244b76a8774e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:23Z,use_quota=True,user_id='8599cc1b87c94c4eaaaeac15384dd079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(804ec365-90e3-4344-b55c-627d872c5f48),volume_type_id=804ec365-90e3-4344-b55c-627d872c5f48)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Creating volume 28f3d091-1039-44f2-9482-b74e406ffbf9 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:25 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:18:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:25 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 1073741824 Sep 28 15:18:25 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:26 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 1073741824" returned: 0 in 0.661s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:26 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 Sep 28 15:18:26 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:26 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9" returned: 0 in 0.383s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Attempting download of 174f0cd3-e959-40b4-82c9-9fd323992b5d ((None, [{'url': 'file:///opt/stack/data/glance/images/174f0cd3-e959-40b4-82c9-9fd323992b5d', 'metadata': {}}])) to volume 28f3d091-1039-44f2-9482-b74e406ffbf9. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa31aba0-522a-49ed-9419-79fc2b9f3670]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_174f0cd3-e959-40b4-82c9-9fd323992b5d_dioi23y4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:26 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_174f0cd3-e959-40b4-82c9-9fd323992b5d_dioi23y4 Sep 28 15:18:26 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:27 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_174f0cd3-e959-40b4-82c9-9fd323992b5d_dioi23y4" returned: 0 in 0.371s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174f0cd3-e959-40b4-82c9-9fd323992b5d_dioi23y4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:27 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174f0cd3-e959-40b4-82c9-9fd323992b5d_dioi23y4 Sep 28 15:18:27 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:27 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174f0cd3-e959-40b4-82c9-9fd323992b5d_dioi23y4" returned: 1 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_174f0cd3-e959-40b4-82c9-9fd323992b5d_dioi23y4' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:27 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8969eb9-7074-419c-a62e-f54e3b4a4974]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:27 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD Sep 28 15:18:27 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:28 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:28 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD Sep 28 15:18:28 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:28 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:28 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] 174f0cd3-e959-40b4-82c9-9fd323992b5d was raw, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:18:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:28 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 Sep 28 15:18:28 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:29 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9" returned: 0 in 0.690s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_174f0cd3-e959-40b4-82c9-9fd323992b5d_6yex29oqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:18:29 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:29 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 1G Sep 28 15:18:29 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:29 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 1G" returned: 0 in 0.482s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Downloaded image 174f0cd3-e959-40b4-82c9-9fd323992b5d ((None, [{'url': 'file:///opt/stack/data/glance/images/174f0cd3-e959-40b4-82c9-9fd323992b5d', 'metadata': {}}])) to volume 28f3d091-1039-44f2-9482-b74e406ffbf9 successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Temporary image 174f0cd3-e959-40b4-82c9-9fd323992b5d for user 8599cc1b87c94c4eaaaeac15384dd079 is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Marking volume 28f3d091-1039-44f2-9482-b74e406ffbf9 as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Copying metadata from image 174f0cd3-e959-40b4-82c9-9fd323992b5d to 28f3d091-1039-44f2-9482-b74e406ffbf9. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Creating volume glance metadata for volume 28f3d091-1039-44f2-9482-b74e406ffbf9 backed by image 174f0cd3-e959-40b4-82c9-9fd323992b5d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '174f0cd3-e959-40b4-82c9-9fd323992b5d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f38097f0b4e10a180b73b53c93b10d21', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8744d8cc-4c38-4c0b-9b6d-1368495c235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f3d091-1039-44f2-9482-b74e406ffbf9', 'volume_size': 1, 'image_id': '174f0cd3-e959-40b4-82c9-9fd323992b5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/174f0cd3-e959-40b4-82c9-9fd323992b5d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f38097f0b4e10a180b73b53c93b10d21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c82802254484e7baf2244b76a8774e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '699f6085e87852d242511ace803c7b3912820c1226867e7e23fabb15a59d9c4aeb016aae455aa1531ab0c9c9c65b4711747e2698665f7f47d8689f7463d01a36', 'id': '174f0cd3-e959-40b4-82c9-9fd323992b5d', 'created_at': datetime.datetime(2026, 9, 28, 13, 18, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 18, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/174f0cd3-e959-40b4-82c9-9fd323992b5d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ec98a-340a-4cba-912c-978ba3d98713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:29 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Volume volume-28f3d091-1039-44f2-9482-b74e406ffbf9 (28f3d091-1039-44f2-9482-b74e406ffbf9): created successfully Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ec98a-340a-4cba-912c-978ba3d98713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Flow 'volume_create_manager' (2b970ed9-24eb-47d2-9bfc-b4516deca3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-66cc67f3-c6df-4512-af30-e1d89c3564e9 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Created volume successfully. Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Acquiring lock "cinder-28f3d091-1039-44f2-9482-b74e406ffbf9-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "cinder-28f3d091-1039-44f2-9482-b74e406ffbf9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Acquiring lock "cinder-quobyte-28f3d091-1039-44f2-9482-b74e406ffbf9" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "cinder-quobyte-28f3d091-1039-44f2-9482-b74e406ffbf9" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc8d63f-18b1-4acb-bca3-95d8ca23d629]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:31 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 Sep 28 15:18:31 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:31 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9" returned: 0 in 0.490s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:31 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9 Sep 28 15:18:31 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:31 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28f3d091-1039-44f2-9482-b74e406ffbf9" returned: 0 in 0.308s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "cinder-quobyte-28f3d091-1039-44f2-9482-b74e406ffbf9" released by "delete_volume" :: held 0.864s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:32 devstack cinder-volume[86384]: WARNING cinder.quota [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:18:32 devstack cinder-volume[86384]: WARNING cinder.quota [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Created reservations ['f5062db1-9da1-4625-b35e-20d04dfdd970', 'aeb37e61-f08d-4be3-9bab-b6d0c31c6c3e', '0de888cb-8bf5-49ce-9671-694243f52808', '4c86bbb6-5e60-4228-a2ad-5ad70c5d4b56'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:32 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:32 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:32 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.366s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:32 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Deleted volume successfully. Sep 28 15:18:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-be46c62c-f4b7-4da7-a029-02e8f76a18f1 tempest-VolumeAndVolumeTypeFromImageTest-2024041086 None] Lock "cinder-28f3d091-1039-44f2-9482-b74e406ffbf9-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:33 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:18:33 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:34 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.485s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:18:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Flow 'volume_create_manager' (f6b955b5-eb8c-44fb-8d39-fe91dfe7d7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5134b709-be30-4e0c-8f63-5da9f3fe09f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5134b709-be30-4e0c-8f63-5da9f3fe09f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-806043256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f61b9ac-9859-4b44-be29-edcb39f84f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84430fe80c49414aa3e87df15075fc7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:42Z,use_quota=True,user_id='60b6321bfba94216a089029b40c50250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88f2d0b-78f9-4406-b2d8-b5df4ef86748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88f2d0b-78f9-4406-b2d8-b5df4ef86748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcaa1d0-46fd-4931-8460-62a94aba570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcaa1d0-46fd-4931-8460-62a94aba570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f61b9ac-9859-4b44-be29-edcb39f84f68', 'volume_name': 'volume-2f61b9ac-9859-4b44-be29-edcb39f84f68', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a410938-7a01-4469-8dea-656a35d465fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a410938-7a01-4469-8dea-656a35d465fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82964e74-81b8-44b2-9d50-644a62f5551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:41 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Volume 2f61b9ac-9859-4b44-be29-edcb39f84f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f61b9ac-9859-4b44-be29-edcb39f84f68', 'volume_size': 1} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-806043256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f61b9ac-9859-4b44-be29-edcb39f84f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84430fe80c49414aa3e87df15075fc7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:42Z,use_quota=True,user_id='60b6321bfba94216a089029b40c50250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Creating volume 2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:41 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:18:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:41 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 1073741824 Sep 28 15:18:41 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:42 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 1073741824" returned: 0 in 0.637s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:42 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 Sep 28 15:18:42 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:42 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68" returned: 0 in 0.376s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82964e74-81b8-44b2-9d50-644a62f5551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f61b9ac-9859-4b44-be29-edcb39f84f68', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624e7fa2-5c7d-4575-a8ac-4ec9baedf81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Volume volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 (2f61b9ac-9859-4b44-be29-edcb39f84f68): created successfully Sep 28 15:18:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624e7fa2-5c7d-4575-a8ac-4ec9baedf81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Flow 'volume_create_manager' (f6b955b5-eb8c-44fb-8d39-fe91dfe7d7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:43 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-13bc5968-33e5-43f6-b189-c7e1810d7be7 tempest-VolumeDependencyTests-240724876 None] Created volume successfully. Sep 28 15:18:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Creating offline snapshot ebabe4ef-c78d-4dae-986d-108d1f0c3451 of volume 2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:44 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e1d5cf-928a-4548-a52f-8b2d5cb34200]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:44 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 Sep 28 15:18:44 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:44 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68" returned: 0 in 0.462s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:44 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 1G Sep 28 15:18:44 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:45 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 1G" returned: 0 in 0.550s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 Sep 28 15:18:45 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:45 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451" returned: 0 in 0.441s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:45 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 is being set with open permissions: ugo+rw Sep 28 15:18:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 Sep 28 15:18:45 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:45 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451" returned: 0 in 0.321s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:46 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.info Sep 28 15:18:46 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:46 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.info" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:46 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.info is being set with open permissions: ugo+rw Sep 28 15:18:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:46 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.info Sep 28 15:18:46 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:46 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.info" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:46 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1b61b466-dbd2-442d-8a94-71ce5cb06d42 tempest-VolumeDependencyTests-240724876 None] Create snapshot completed successfully Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Flow 'volume_create_manager' (85210fec-c114-48f3-8ed5-44fb2d910ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1481ab0a-3944-4f12-83f1-f08035cca692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1481ab0a-3944-4f12-83f1-f08035cca692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2069787772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e67ef6a-1034-4780-9a81-488d24215c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84430fe80c49414aa3e87df15075fc7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebabe4ef-c78d-4dae-986d-108d1f0c3451,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:48Z,use_quota=True,user_id='60b6321bfba94216a089029b40c50250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fd142a-f157-4861-9195-ea74f7ce555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fd142a-f157-4861-9195-ea74f7ce555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6322a4-aa48-4edd-921e-3da3ed4512d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6322a4-aa48-4edd-921e-3da3ed4512d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e67ef6a-1034-4780-9a81-488d24215c1d', 'volume_name': 'volume-8e67ef6a-1034-4780-9a81-488d24215c1d', 'volume_size': 1, 'snapshot_id': 'ebabe4ef-c78d-4dae-986d-108d1f0c3451'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947cccf3-8d2a-430f-81e0-ce38fb52a649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947cccf3-8d2a-430f-81e0-ce38fb52a649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2813c51-2ac9-418b-ae76-a3866778a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Volume 8e67ef6a-1034-4780-9a81-488d24215c1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e67ef6a-1034-4780-9a81-488d24215c1d', 'volume_size': 1, 'snapshot_id': 'ebabe4ef-c78d-4dae-986d-108d1f0c3451'} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-quobyte-ebabe4ef-c78d-4dae-986d-108d1f0c3451-8e67ef6a-1034-4780-9a81-488d24215c1d" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-ebabe4ef-c78d-4dae-986d-108d1f0c3451-8e67ef6a-1034-4780-9a81-488d24215c1d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Creating volume 8e67ef6a-1034-4780-9a81-488d24215c1d from snapshot ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-quobyte-8e67ef6a-1034-4780-9a81-488d24215c1d" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-8e67ef6a-1034-4780-9a81-488d24215c1d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] snapshot: ebabe4ef-c78d-4dae-986d-108d1f0c3451, volume: 8e67ef6a-1034-4780-9a81-488d24215c1d, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93edb05-64f5-41da-abb0-a25922a9b1ef]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Flow 'volume_create_manager' (11857ced-e250-466d-9e33-08cf16d82a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb427bc3-d986-4521-ba5c-24ee3401627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb427bc3-d986-4521-ba5c-24ee3401627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-155709649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2fdd6b-5184-48fb-a520-2cfa5a03375c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a075c14ea3184789b0079d486e650f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:48Z,use_quota=True,user_id='5c9f818b49694b8dbec33e43ff4e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab31c3e-85da-4c51-be8c-7b3b7b9c9892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab31c3e-85da-4c51-be8c-7b3b7b9c9892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2652852d-5ef0-431d-8a94-804ad1583f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2652852d-5ef0-431d-8a94-804ad1583f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2fdd6b-5184-48fb-a520-2cfa5a03375c', 'volume_name': 'volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d994398-58c0-4f8f-b5d7-fbfedc6cae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 Sep 28 15:18:48 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d994398-58c0-4f8f-b5d7-fbfedc6cae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98d2e49-fe32-4ecc-9b00-fb0f7f72d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Volume ae2fdd6b-5184-48fb-a520-2cfa5a03375c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c', 'volume_size': 1} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:48 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451" returned: 0 in 0.444s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f61b9ac-9859-4b44-be29-edcb39f84f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad67621d-0bbb-4383-b759-3496b31dfb0f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:48 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 Sep 28 15:18:48 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:49 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68" returned: 0 in 0.500s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:18:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:18:49 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:18:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:49 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d Sep 28 15:18:49 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:56 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d" returned: 0 in 7.112s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:18:56 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Converted 1024.00 MB image at 143.96 MB/s Sep 28 15:18:56 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d is being set with open permissions: ugo+rw Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:56 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d Sep 28 15:18:56 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:56 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d" returned: 0 in 0.280s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-8e67ef6a-1034-4780-9a81-488d24215c1d" released by "_copy_volume_from_snapshot" :: held 8.468s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=59,cinder:UPDATE=81,cinder:DELETE=6,cinder:INSERT=19 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=77,cinder:SELECT=63,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-ebabe4ef-c78d-4dae-986d-108d1f0c3451-8e67ef6a-1034-4780-9a81-488d24215c1d" released by "_create_volume_from_snapshot" :: held 8.555s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.579s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.300s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-155709649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2fdd6b-5184-48fb-a520-2cfa5a03375c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a075c14ea3184789b0079d486e650f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:48Z,use_quota=True,user_id='5c9f818b49694b8dbec33e43ff4e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Creating volume ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:56 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:56 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c 1073741824 Sep 28 15:18:56 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2813c51-2ac9-418b-ae76-a3866778a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e67ef6a-1034-4780-9a81-488d24215c1d', 'volume_size': 1, 'snapshot_id': 'ebabe4ef-c78d-4dae-986d-108d1f0c3451'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7a6c94-0ea8-4e5e-b98d-197847163d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:56 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Volume volume-8e67ef6a-1034-4780-9a81-488d24215c1d (8e67ef6a-1034-4780-9a81-488d24215c1d): created successfully Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7a6c94-0ea8-4e5e-b98d-197847163d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:56 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Flow 'volume_create_manager' (85210fec-c114-48f3-8ed5-44fb2d910ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-582861a1-846e-4f2f-be3f-002af8a804c8 tempest-VolumeDependencyTests-240724876 None] Created volume successfully. Sep 28 15:18:57 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c 1073741824" returned: 0 in 0.638s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:57 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c Sep 28 15:18:57 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" returned: 0 in 0.340s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98d2e49-fe32-4ecc-9b00-fb0f7f72d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31452407-3e77-418d-b8d3-9c654c51946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Volume volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c (ae2fdd6b-5184-48fb-a520-2cfa5a03375c): created successfully Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31452407-3e77-418d-b8d3-9c654c51946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Flow 'volume_create_manager' (11857ced-e250-466d-9e33-08cf16d82a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-ebabe4ef-c78d-4dae-986d-108d1f0c3451-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:57 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-73ff4370-4200-4cc1-ad35-9db81db045d0 tempest-SnapshotDependencyTests-1893131198 None] Created volume successfully. Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Lock "cinder-ebabe4ef-c78d-4dae-986d-108d1f0c3451-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-quobyte-2f61b9ac-9859-4b44-be29-edcb39f84f68" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-2f61b9ac-9859-4b44-be29-edcb39f84f68" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-quobyte-ebabe4ef-c78d-4dae-986d-108d1f0c3451" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-ebabe4ef-c78d-4dae-986d-108d1f0c3451" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Deleting offline snapshot ebabe4ef-c78d-4dae-986d-108d1f0c3451 of volume 2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] snapshot_file for this snap is: volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5338e3df-e69c-44ed-b233-6f180650f098]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:58 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 Sep 28 15:18:58 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:58 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451" returned: 0 in 0.413s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f61b9ac-9859-4b44-be29-edcb39f84f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f1e136-6938-4536-93db-921e00239ee4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:58 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 Sep 28 15:18:58 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Creating offline snapshot 188c8943-217d-4455-9089-72695cf32987 of volume ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[64821479-9b5c-44dd-9650-0a95ea158272]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:59 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c Sep 28 15:18:59 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68" returned: 0 in 0.693s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:59 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 Sep 28 15:18:59 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" returned: 0 in 0.436s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:59 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 1G Sep 28 15:18:59 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451" returned: 0 in 0.384s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:59 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451 Sep 28 15:18:59 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 1G" returned: 0 in 0.507s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:59 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 Sep 28 15:18:59 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:59 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68.ebabe4ef-c78d-4dae-986d-108d1f0c3451" returned: 0 in 0.322s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-ebabe4ef-c78d-4dae-986d-108d1f0c3451" released by "_delete_snapshot" :: held 1.946s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-2f61b9ac-9859-4b44-be29-edcb39f84f68" released by "delete_snapshot" :: held 1.973s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Created reservations ['c1dbb61e-7a0f-41bd-8871-34107e156422', '6f624241-aa7d-4d6b-b0a3-092007ca942d', '9826d250-a9e2-4fff-84a1-ec124fbee92b', '5b3a3aed-8f60-4198-9dd7-0bdc7e307c2e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Delete snapshot completed successfully. Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-729f3ff9-61dc-4860-b12c-c2c3e99f71fc tempest-VolumeDependencyTests-240724876 None] Lock "cinder-ebabe4ef-c78d-4dae-986d-108d1f0c3451-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-2f61b9ac-9859-4b44-be29-edcb39f84f68-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-2f61b9ac-9859-4b44-be29-edcb39f84f68-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:00 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987" returned: 0 in 0.364s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 is being set with open permissions: ugo+rw Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 Sep 28 15:19:00 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-quobyte-2f61b9ac-9859-4b44-be29-edcb39f84f68" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-2f61b9ac-9859-4b44-be29-edcb39f84f68" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0aec96-7deb-4d63-995c-6313f6656fb2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 Sep 28 15:19:00 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987" returned: 0 in 0.326s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.info Sep 28 15:19:00 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68" returned: 0 in 0.449s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68 Sep 28 15:19:00 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.info" returned: 0 in 0.359s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.info is being set with open permissions: ugo+rw Sep 28 15:19:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.info Sep 28 15:19:00 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Flow 'volume_create_manager' (e24313c5-239b-4f2a-bab4-0de6b208a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea924e85-efc9-4532-b8c2-c9c54b60fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:01 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea924e85-efc9-4532-b8c2-c9c54b60fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-420877514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328b26e-5c18-4b0e-ac7b-83f6db22a873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb86d83dc9e74a2dbf30b8f849c3d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:01Z,use_quota=True,user_id='46073297641c4b1182b2ed338c42b9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe290e9-2a79-432a-b028-278ca67e7a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe290e9-2a79-432a-b028-278ca67e7a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9799b3b1-ccef-4864-81ab-4e709edf9c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9799b3b1-ccef-4864-81ab-4e709edf9c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e328b26e-5c18-4b0e-ac7b-83f6db22a873', 'volume_name': 'volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adc382a-d22f-4b87-9ed9-3a97130b3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adc382a-d22f-4b87-9ed9-3a97130b3574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f46ed80-dd18-452d-aaa2-99355b580386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Volume e328b26e-5c18-4b0e-ac7b-83f6db22a873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873', 'volume_size': 1} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2f61b9ac-9859-4b44-be29-edcb39f84f68" returned: 0 in 0.399s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-2f61b9ac-9859-4b44-be29-edcb39f84f68" released by "delete_volume" :: held 0.934s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Created reservations ['32442828-a48f-4ae6-b8a5-14fbf4cc34f4', '6ca35bcd-8426-4d55-a416-3f3a13c0128e', 'e8ab611a-7796-4735-9dfc-7c11120b497a', 'a1deaf93-af93-4402-988c-680dd5184f5b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:01 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.info" returned: 0 in 0.358s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-420877514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328b26e-5c18-4b0e-ac7b-83f6db22a873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb86d83dc9e74a2dbf30b8f849c3d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:01Z,use_quota=True,user_id='46073297641c4b1182b2ed338c42b9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Creating volume e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:01 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 1073741824 Sep 28 15:19:01 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dc4f36ca-3994-42ba-9f99-3b6b210dd56c tempest-SnapshotDependencyTests-1893131198 None] Create snapshot completed successfully Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:01 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:19:01 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.291s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Deleted volume successfully. Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2bf1c7eb-8570-416a-bc44-40d4b1050234 tempest-VolumeDependencyTests-240724876 None] Lock "cinder-2f61b9ac-9859-4b44-be29-edcb39f84f68-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:01 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 1073741824" returned: 0 in 0.585s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:02 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 Sep 28 15:19:02 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:02 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873" returned: 0 in 0.291s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f46ed80-dd18-452d-aaa2-99355b580386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b535abee-c24e-46f1-aeb7-5e6f2cf1d3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Volume volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 (e328b26e-5c18-4b0e-ac7b-83f6db22a873): created successfully Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b535abee-c24e-46f1-aeb7-5e6f2cf1d3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Flow 'volume_create_manager' (e24313c5-239b-4f2a-bab4-0de6b208a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-61f1d58f-40f4-4ff2-b659-52c1f8c28057 tempest-TestStampPattern-1659809935 None] Created volume successfully. Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-8e67ef6a-1034-4780-9a81-488d24215c1d-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Lock "cinder-8e67ef6a-1034-4780-9a81-488d24215c1d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Acquiring lock "cinder-quobyte-8e67ef6a-1034-4780-9a81-488d24215c1d" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-8e67ef6a-1034-4780-9a81-488d24215c1d" acquired by "delete_volume" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[746a7cc5-2c8d-4dc1-99ca-d9009231d1ff]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:02 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d Sep 28 15:19:02 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Flow 'volume_create_manager' (176bf090-ea58-4717-bb39-ca72d153ddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553b8d0a-331c-4ffb-bc78-6709259cad15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553b8d0a-331c-4ffb-bc78-6709259cad15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff80a42-91cd-4660-975f-eab4f425656c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a075c14ea3184789b0079d486e650f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=188c8943-217d-4455-9089-72695cf32987,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:03Z,use_quota=True,user_id='5c9f818b49694b8dbec33e43ff4e4cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c6faf5-49fa-4254-acf9-730931f34db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c6faf5-49fa-4254-acf9-730931f34db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e83b7-eeeb-480a-8edb-a0451ef8b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e83b7-eeeb-480a-8edb-a0451ef8b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ff80a42-91cd-4660-975f-eab4f425656c', 'volume_name': 'volume-5ff80a42-91cd-4660-975f-eab4f425656c', 'volume_size': 1, 'snapshot_id': '188c8943-217d-4455-9089-72695cf32987'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8802909f-3915-4886-84c1-d62684f2880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8802909f-3915-4886-84c1-d62684f2880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1534ace7-4940-4962-bc73-7a2663bb2bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Volume 5ff80a42-91cd-4660-975f-eab4f425656c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ff80a42-91cd-4660-975f-eab4f425656c', 'volume_size': 1, 'snapshot_id': '188c8943-217d-4455-9089-72695cf32987'} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-quobyte-188c8943-217d-4455-9089-72695cf32987-5ff80a42-91cd-4660-975f-eab4f425656c" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-188c8943-217d-4455-9089-72695cf32987-5ff80a42-91cd-4660-975f-eab4f425656c" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Creating volume 5ff80a42-91cd-4660-975f-eab4f425656c from snapshot 188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-quobyte-5ff80a42-91cd-4660-975f-eab4f425656c" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-5ff80a42-91cd-4660-975f-eab4f425656c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] snapshot: 188c8943-217d-4455-9089-72695cf32987, volume: 5ff80a42-91cd-4660-975f-eab4f425656c, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[87506af8-7cef-49ed-b039-9d82df6788bf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:03 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d" returned: 0 in 0.499s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:03 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d Sep 28 15:19:03 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:03 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 Sep 28 15:19:03 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:03 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-8e67ef6a-1034-4780-9a81-488d24215c1d" returned: 0 in 0.330s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Lock "cinder-quobyte-8e67ef6a-1034-4780-9a81-488d24215c1d" released by "delete_volume" :: held 0.927s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:03 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987" returned: 0 in 0.498s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc79aa-d5c9-448e-8fd5-59ba815648e4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Created reservations ['3dc27e05-41a7-4f48-9b81-117507435a83', 'a0543e48-2bab-416d-82f5-599b698b7f3d', 'ed952106-b8b4-4782-8e28-f0ff96541126', '4d1fe420-aba0-40f3-a6d7-01769fbda44b'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:03 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:03 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:03 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:19:03 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:04 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.446s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Deleted volume successfully. Sep 28 15:19:04 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" returned: 0 in 0.651s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:04 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c Sep 28 15:19:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ef8a857-d374-49c4-9a81-497e8c28d07d tempest-VolumeDependencyTests-240724876 None] Lock "cinder-8e67ef6a-1034-4780-9a81-488d24215c1d-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:04 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:13 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=30,cinder:INSERT=11,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:14 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c" returned: 0 in 9.912s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c, size 1024.00 MB, duration 9.91 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:19:14 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Converted 1024.00 MB image at 103.30 MB/s Sep 28 15:19:14 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c is being set with open permissions: ugo+rw Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:14 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c Sep 28 15:19:14 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=33,cinder:SELECT=20,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:14 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c" returned: 0 in 0.385s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-5ff80a42-91cd-4660-975f-eab4f425656c" released by "_copy_volume_from_snapshot" :: held 11.569s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-188c8943-217d-4455-9089-72695cf32987-5ff80a42-91cd-4660-975f-eab4f425656c" released by "_create_volume_from_snapshot" :: held 11.684s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.706s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1534ace7-4940-4962-bc73-7a2663bb2bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff80a42-91cd-4660-975f-eab4f425656c', 'volume_size': 1, 'snapshot_id': '188c8943-217d-4455-9089-72695cf32987'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f993cb0d-c88a-41c2-9fb4-0acbc4082aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Volume volume-5ff80a42-91cd-4660-975f-eab4f425656c (5ff80a42-91cd-4660-975f-eab4f425656c): created successfully Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f993cb0d-c88a-41c2-9fb4-0acbc4082aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Flow 'volume_create_manager' (176bf090-ea58-4717-bb39-ca72d153ddea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1069a835-ecf8-41f4-9f08-0ef6d24d3d96 tempest-SnapshotDependencyTests-1893131198 None] Created volume successfully. Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-188c8943-217d-4455-9089-72695cf32987-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-188c8943-217d-4455-9089-72695cf32987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-quobyte-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-quobyte-188c8943-217d-4455-9089-72695cf32987" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-188c8943-217d-4455-9089-72695cf32987" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Deleting offline snapshot 188c8943-217d-4455-9089-72695cf32987 of volume ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] snapshot_file for this snap is: volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee2b329-4980-4e68-8839-710183305aea]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:16 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 Sep 28 15:19:16 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:16 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987" returned: 0 in 0.476s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7cc45-2adc-45ef-8fd9-56b7d85c78d0]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:16 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c Sep 28 15:19:16 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:17 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" returned: 0 in 0.750s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:17 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 Sep 28 15:19:17 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:17 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987" returned: 0 in 0.536s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:17 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987 Sep 28 15:19:17 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:18 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c.188c8943-217d-4455-9089-72695cf32987" returned: 0 in 0.441s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-188c8943-217d-4455-9089-72695cf32987" released by "_delete_snapshot" :: held 2.379s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" released by "delete_snapshot" :: held 2.421s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:18 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Created reservations ['99cca42b-60a8-491c-b4f3-8ac3ea852635', '2d7fbbcc-cb12-4c89-9656-27aeaff5767d', '2d4bdb72-8a21-4946-afd3-7db3c8d96004', '95103beb-448e-4537-b279-763f07eb0d78'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Delete snapshot completed successfully. Sep 28 15:19:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-3e0310e7-b68e-4a85-b06f-ab0b1de62f20 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-188c8943-217d-4455-9089-72695cf32987-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-ae2fdd6b-5184-48fb-a520-2cfa5a03375c-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-ae2fdd6b-5184-48fb-a520-2cfa5a03375c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-quobyte-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f78553-b004-40fc-9bde-60f0a0248f42]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:19 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c Sep 28 15:19:19 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:19 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" returned: 0 in 0.406s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:19 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c Sep 28 15:19:19 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:19 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" returned: 0 in 0.295s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-ae2fdd6b-5184-48fb-a520-2cfa5a03375c" released by "delete_volume" :: held 0.794s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Created reservations ['0d37d452-e89a-4bf4-8780-20c16abcdd57', '11c7557a-a0a1-49a5-9f84-454582fdf517', '2faf20e4-98a0-43a9-8879-979cd95b29d6', '4933ab40-7aeb-4a05-a224-76e1847ef8a2'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:20 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:19:20 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-5ff80a42-91cd-4660-975f-eab4f425656c-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-5ff80a42-91cd-4660-975f-eab4f425656c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "cinder-quobyte-5ff80a42-91cd-4660-975f-eab4f425656c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-5ff80a42-91cd-4660-975f-eab4f425656c" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6459e45-7c39-41e1-ada6-a32c1fd96c41]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:20 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.328s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Deleted volume successfully. Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16f956ef-a319-49fa-992c-c70a721fd5ad tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-ae2fdd6b-5184-48fb-a520-2cfa5a03375c-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:20 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c Sep 28 15:19:20 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:20 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c" returned: 0 in 0.402s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:20 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c Sep 28 15:19:20 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:21 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5ff80a42-91cd-4660-975f-eab4f425656c" returned: 0 in 0.252s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-quobyte-5ff80a42-91cd-4660-975f-eab4f425656c" released by "delete_volume" :: held 0.713s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Created reservations ['768fdb3d-bd41-48c7-b617-69c95efce637', '6d2aa2e4-e693-4959-9c98-f70068d19641', 'ddccdc9c-51bf-4913-a305-6d6610c7031f', 'a3c310cc-9a57-4b29-9310-18d2d0d3ecd9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:21 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:19:21 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:21 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.284s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Deleted volume successfully. Sep 28 15:19:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6606c173-1f5c-40ac-9af7-9aeed7276043 tempest-SnapshotDependencyTests-1893131198 None] Lock "cinder-5ff80a42-91cd-4660-975f-eab4f425656c-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:31 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=28 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:31 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=18,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:33 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:19:33 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:34 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.395s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:19:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:19:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-f97572a6-3e67-401c-bbf8-96c64f90afa6 req-4e4d7bcf-b64a-424c-bc0b-a600272b1db6 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-f97572a6-3e67-401c-bbf8-96c64f90afa6 req-4e4d7bcf-b64a-424c-bc0b-a600272b1db6 tempest-TestStampPattern-1659809935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-f97572a6-3e67-401c-bbf8-96c64f90afa6 req-4e4d7bcf-b64a-424c-bc0b-a600272b1db6 tempest-TestStampPattern-1659809935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-f97572a6-3e67-401c-bbf8-96c64f90afa6 req-4e4d7bcf-b64a-424c-bc0b-a600272b1db6 tempest-TestStampPattern-1659809935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dbdeda0-d5cd-4693-9849-00e0d91c4667', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:19:39 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-f97572a6-3e67-401c-bbf8-96c64f90afa6 req-4e4d7bcf-b64a-424c-bc0b-a600272b1db6 tempest-TestStampPattern-1659809935 None] attachment_update completed successfully. Sep 28 15:19:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-063781ca-756b-4219-9f86-8abb4e82e1e8 req-10eee91a-cc8d-4ca7-acb1-4f5b66396232 tempest-TestStampPattern-1659809935 None] Terminate volume connection completed successfully. Sep 28 15:19:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-063781ca-756b-4219-9f86-8abb4e82e1e8 req-10eee91a-cc8d-4ca7-acb1-4f5b66396232 tempest-TestStampPattern-1659809935 None] Deleting attachment 0dbdeda0-d5cd-4693-9849-00e0d91c4667. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:19:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Creating offline snapshot 349e392e-0280-4444-ae0f-659ce41569e3 of volume e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:19:45 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d8bc9-ebfa-407d-95b1-3cb543c135db]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:45 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 Sep 28 15:19:45 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:46 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873" returned: 0 in 0.417s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:46 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 1G Sep 28 15:19:46 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:46 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 1G" returned: 0 in 0.431s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:46 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 Sep 28 15:19:46 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:46 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3" returned: 0 in 0.356s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:46 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 is being set with open permissions: ugo+rw Sep 28 15:19:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:46 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 Sep 28 15:19:46 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:47 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3" returned: 0 in 0.272s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:47 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.info Sep 28 15:19:47 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:47 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.info" returned: 0 in 0.254s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:47 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.info is being set with open permissions: ugo+rw Sep 28 15:19:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:47 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.info Sep 28 15:19:47 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:47 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.info" returned: 0 in 0.256s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9921467a-1542-46ed-9b20-22df70474b79 tempest-TestStampPattern-1659809935 None] Create snapshot completed successfully Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Flow 'volume_create_manager' (5c48bb3b-26d3-488d-8771-dbe0a5c00941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5995b35c-432e-42be-a0d1-98d579b46303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5995b35c-432e-42be-a0d1-98d579b46303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1542626724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b82cff-9462-482e-a5be-e542dfea1501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb86d83dc9e74a2dbf30b8f849c3d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=349e392e-0280-4444-ae0f-659ce41569e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:55Z,use_quota=True,user_id='46073297641c4b1182b2ed338c42b9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d4060-9d19-4518-925f-3812c29f9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d4060-9d19-4518-925f-3812c29f9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86e642a-fa9a-4350-a9bd-1b2db03c14bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86e642a-fa9a-4350-a9bd-1b2db03c14bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28b82cff-9462-482e-a5be-e542dfea1501', 'volume_name': 'volume-28b82cff-9462-482e-a5be-e542dfea1501', 'volume_size': 1, 'snapshot_id': '349e392e-0280-4444-ae0f-659ce41569e3'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044f434b-009c-4d87-a019-d5f5beed5cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044f434b-009c-4d87-a019-d5f5beed5cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b9a7f4-a253-4b40-be80-f43ba22e2646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:55 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Volume 28b82cff-9462-482e-a5be-e542dfea1501: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28b82cff-9462-482e-a5be-e542dfea1501', 'volume_size': 1, 'snapshot_id': '349e392e-0280-4444-ae0f-659ce41569e3'} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-quobyte-349e392e-0280-4444-ae0f-659ce41569e3-28b82cff-9462-482e-a5be-e542dfea1501" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-349e392e-0280-4444-ae0f-659ce41569e3-28b82cff-9462-482e-a5be-e542dfea1501" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Creating volume 28b82cff-9462-482e-a5be-e542dfea1501 from snapshot 349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-quobyte-28b82cff-9462-482e-a5be-e542dfea1501" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-28b82cff-9462-482e-a5be-e542dfea1501" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] snapshot: 349e392e-0280-4444-ae0f-659ce41569e3, volume: 28b82cff-9462-482e-a5be-e542dfea1501, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[411db11e-e520-40ad-99c0-73c76a0718fd]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:55 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 Sep 28 15:19:55 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:56 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3" returned: 0 in 0.403s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7d26ad-e007-4301-9a51-87d1b814c274]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:56 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 Sep 28 15:19:56 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:56 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873" returned: 0 in 0.441s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:19:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:56 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 Sep 28 15:19:56 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501" returned: 0 in 8.377s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:20:05 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Converted 1024.00 MB image at 122.23 MB/s Sep 28 15:20:05 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 is being set with open permissions: ugo+rw Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:05 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 Sep 28 15:20:05 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:05 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501" returned: 0 in 0.353s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-28b82cff-9462-482e-a5be-e542dfea1501" released by "_copy_volume_from_snapshot" :: held 9.690s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-349e392e-0280-4444-ae0f-659ce41569e3-28b82cff-9462-482e-a5be-e542dfea1501" released by "_create_volume_from_snapshot" :: held 9.783s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.806s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b9a7f4-a253-4b40-be80-f43ba22e2646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b82cff-9462-482e-a5be-e542dfea1501', 'volume_size': 1, 'snapshot_id': '349e392e-0280-4444-ae0f-659ce41569e3'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25891a10-4c03-4102-adb8-2a6f46104d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Volume volume-28b82cff-9462-482e-a5be-e542dfea1501 (28b82cff-9462-482e-a5be-e542dfea1501): created successfully Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25891a10-4c03-4102-adb8-2a6f46104d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Flow 'volume_create_manager' (5c48bb3b-26d3-488d-8771-dbe0a5c00941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8ad3069f-3135-4ed5-b329-2f90adafad54 tempest-TestStampPattern-1659809935 None] Created volume successfully. Sep 28 15:20:15 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:15 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:33 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:20:33 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:34 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.251s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:20:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:20:43 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-2dab6028-4375-4aad-8ea4-398469de6dc9 req-e930ecd3-88cc-4c79-b639-2d774f640125 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-2dab6028-4375-4aad-8ea4-398469de6dc9 req-e930ecd3-88cc-4c79-b639-2d774f640125 tempest-TestStampPattern-1659809935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [req-2dab6028-4375-4aad-8ea4-398469de6dc9 req-e930ecd3-88cc-4c79-b639-2d774f640125 tempest-TestStampPattern-1659809935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-2dab6028-4375-4aad-8ea4-398469de6dc9 req-e930ecd3-88cc-4c79-b639-2d774f640125 tempest-TestStampPattern-1659809935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d', 'name': 'volume-28b82cff-9462-482e-a5be-e542dfea1501', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81b13bce-1cd3-4e55-87a9-f39882cd3a0b', 'enforce_multipath': True} {{(pid=86384) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:20:46 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-2dab6028-4375-4aad-8ea4-398469de6dc9 req-e930ecd3-88cc-4c79-b639-2d774f640125 tempest-TestStampPattern-1659809935 None] attachment_update completed successfully. Sep 28 15:20:50 devstack cinder-volume[86384]: INFO cinder.volume.manager [req-84546fb4-47a2-4628-8b62-c70f030551b5 req-b3e97a94-bd1c-4288-9fac-f53de1504242 tempest-TestStampPattern-1659809935 None] Terminate volume connection completed successfully. Sep 28 15:20:50 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [req-84546fb4-47a2-4628-8b62-c70f030551b5 req-b3e97a94-bd1c-4288-9fac-f53de1504242 tempest-TestStampPattern-1659809935 None] Deleting attachment 81b13bce-1cd3-4e55-87a9-f39882cd3a0b. {{(pid=86384) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:20:56 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-28b82cff-9462-482e-a5be-e542dfea1501-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Lock "cinder-28b82cff-9462-482e-a5be-e542dfea1501-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-quobyte-28b82cff-9462-482e-a5be-e542dfea1501" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-28b82cff-9462-482e-a5be-e542dfea1501" acquired by "delete_volume" :: waited 0.014s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86271ce-c4ee-4f1c-b79f-456d83749d90]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:58 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 Sep 28 15:20:58 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:58 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501" returned: 0 in 0.369s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:58 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501 Sep 28 15:20:58 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:59 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-28b82cff-9462-482e-a5be-e542dfea1501" returned: 0 in 0.245s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-28b82cff-9462-482e-a5be-e542dfea1501" released by "delete_volume" :: held 0.663s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Created reservations ['7e0eb6ee-0ca7-49d6-b4d2-a7d1da8a9cde', '7e3ab1f3-bc52-418b-b7f2-a93906407c66', 'd0e206f6-a8d5-4adf-a1f7-0ee13fdb9622', '8abddbba-d9ad-4621-bb69-238d3ed787be'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:59 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:20:59 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:59 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.313s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Deleted volume successfully. Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef872fce-ee87-4313-855a-cd8e207d0e6a tempest-TestStampPattern-1659809935 None] Lock "cinder-28b82cff-9462-482e-a5be-e542dfea1501-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-349e392e-0280-4444-ae0f-659ce41569e3-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Lock "cinder-349e392e-0280-4444-ae0f-659ce41569e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-quobyte-e328b26e-5c18-4b0e-ac7b-83f6db22a873" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-e328b26e-5c18-4b0e-ac7b-83f6db22a873" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-quobyte-349e392e-0280-4444-ae0f-659ce41569e3" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-349e392e-0280-4444-ae0f-659ce41569e3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Deleting offline snapshot 349e392e-0280-4444-ae0f-659ce41569e3 of volume e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] snapshot_file for this snap is: volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dbe2ed-89bf-431d-9b53-8eb06110e6e4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:00 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 Sep 28 15:21:00 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:00 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3" returned: 0 in 0.367s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:21:00 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8025a9eb-9f78-4941-9114-08b99e8dd73e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:00 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 Sep 28 15:21:00 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:00 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873" returned: 0 in 0.534s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:00 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 Sep 28 15:21:00 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:01 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:01 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3 Sep 28 15:21:01 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:01 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873.349e392e-0280-4444-ae0f-659ce41569e3" returned: 0 in 0.269s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-349e392e-0280-4444-ae0f-659ce41569e3" released by "_delete_snapshot" :: held 1.651s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-e328b26e-5c18-4b0e-ac7b-83f6db22a873" released by "delete_snapshot" :: held 1.672s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:01 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Created reservations ['010191a7-daec-4e95-b7d2-22f080b3b667', 'cb4e7fea-8005-45b2-96bf-b2cfdc595de9', 'e3b67822-24f5-4236-92d8-15b2f758805b', 'b2f840d3-d8ea-411e-b29b-6b0aa5b9f761'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Delete snapshot completed successfully. Sep 28 15:21:01 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9fc6b11a-d901-4ce6-b5d3-6e103cc65100 tempest-TestStampPattern-1659809935 None] Lock "cinder-349e392e-0280-4444-ae0f-659ce41569e3-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-e328b26e-5c18-4b0e-ac7b-83f6db22a873-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Lock "cinder-e328b26e-5c18-4b0e-ac7b-83f6db22a873-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Acquiring lock "cinder-quobyte-e328b26e-5c18-4b0e-ac7b-83f6db22a873" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-e328b26e-5c18-4b0e-ac7b-83f6db22a873" acquired by "delete_volume" :: waited 0.014s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddcebcb-a7d5-48af-9fc7-e1b25b4fb20c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 Sep 28 15:21:06 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873" returned: 0 in 0.340s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873 Sep 28 15:21:06 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-e328b26e-5c18-4b0e-ac7b-83f6db22a873" returned: 0 in 0.240s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Lock "cinder-quobyte-e328b26e-5c18-4b0e-ac7b-83f6db22a873" released by "delete_volume" :: held 0.641s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Created reservations ['6f94eba2-c1f3-48e0-afb1-7c9cc2831d57', 'edd61074-a8f4-43f8-826f-d768cfbc246e', '43f77d58-e124-4c29-9d84-b852d3f40a55', '0f4c8fb7-eabe-4ccf-972b-0fb8b5a74771'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:06 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.241s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Deleted volume successfully. Sep 28 15:21:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-380c28ea-8798-4a7e-827f-5ce31fff8165 tempest-TestStampPattern-1659809935 None] Lock "cinder-e328b26e-5c18-4b0e-ac7b-83f6db22a873-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:16 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=19,cinder:SELECT=17,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:16 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (2926dbf1-3d6b-4abb-b9cf-38879295d17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8fe713-9d12-47a8-91a4-bc5109a5d768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8fe713-9d12-47a8-91a4-bc5109a5d768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570892541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58df9881-6959-47ef-91bc-f77f0b0a2949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:19Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673f8f9f-9be7-4c71-b03a-5d981f09fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673f8f9f-9be7-4c71-b03a-5d981f09fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f803f6-cd5b-4e82-8c8a-801bff73633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f803f6-cd5b-4e82-8c8a-801bff73633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58df9881-6959-47ef-91bc-f77f0b0a2949', 'volume_name': 'volume-58df9881-6959-47ef-91bc-f77f0b0a2949', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e643cf-710f-4337-9136-bcedf7ed2ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e643cf-710f-4337-9136-bcedf7ed2ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f659bdd1-2005-49bf-8459-2dcdd4dda659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:18 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume 58df9881-6959-47ef-91bc-f77f0b0a2949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58df9881-6959-47ef-91bc-f77f0b0a2949', 'volume_size': 1} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570892541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58df9881-6959-47ef-91bc-f77f0b0a2949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:19Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Creating volume 58df9881-6959-47ef-91bc-f77f0b0a2949 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:18 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:19 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 1073741824 Sep 28 15:21:19 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:19 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 1073741824" returned: 0 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:19 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 Sep 28 15:21:19 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:19 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949" returned: 0 in 0.256s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f659bdd1-2005-49bf-8459-2dcdd4dda659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58df9881-6959-47ef-91bc-f77f0b0a2949', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817ffa80-13e3-483c-a7ea-3a60eb63df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:19 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume volume-58df9881-6959-47ef-91bc-f77f0b0a2949 (58df9881-6959-47ef-91bc-f77f0b0a2949): created successfully Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817ffa80-13e3-483c-a7ea-3a60eb63df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:19 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (2926dbf1-3d6b-4abb-b9cf-38879295d17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7e920c1e-82a4-4c6f-88f3-b9b7668707f0 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created volume successfully. Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (c6550ee7-4fb7-4545-aca6-3c8d2a82bba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13836947-e613-41ed-a1bc-563ed4bb0e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13836947-e613-41ed-a1bc-563ed4bb0e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-449532658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cc2daa-bf24-4bdd-947d-696c582689aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:20Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5885906f-5c31-4774-9e06-c9168646423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5885906f-5c31-4774-9e06-c9168646423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350895df-0caf-4e00-988c-086fae47ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350895df-0caf-4e00-988c-086fae47ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2cc2daa-bf24-4bdd-947d-696c582689aa', 'volume_name': 'volume-f2cc2daa-bf24-4bdd-947d-696c582689aa', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb595c19-49ad-4cd3-b25d-9f17de5c2f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb595c19-49ad-4cd3-b25d-9f17de5c2f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9b12b6-57cf-465c-bdf3-83fb2557c287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume f2cc2daa-bf24-4bdd-947d-696c582689aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2cc2daa-bf24-4bdd-947d-696c582689aa', 'volume_size': 1} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-449532658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cc2daa-bf24-4bdd-947d-696c582689aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:20Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Creating volume f2cc2daa-bf24-4bdd-947d-696c582689aa {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:20 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:20 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa 1073741824 Sep 28 15:21:20 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (d52b71de-c450-4a5a-8706-03b397bf48b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c419406c-83d8-44c9-8e4d-bf534ab0da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c419406c-83d8-44c9-8e4d-bf534ab0da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289938554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a76864-8d2a-4cf5-b2da-c930236e3b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:21Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f367435f-a96b-42fc-8431-19ec5c0b7f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f367435f-a96b-42fc-8431-19ec5c0b7f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762d495a-7144-4255-a99f-04a28bd65fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762d495a-7144-4255-a99f-04a28bd65fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a76864-8d2a-4cf5-b2da-c930236e3b7b', 'volume_name': 'volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7b56f6-da88-406f-8105-500130a62956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7b56f6-da88-406f-8105-500130a62956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f0aea-5289-4962-8f23-f9dd1f7e3557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:20 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume 56a76864-8d2a-4cf5-b2da-c930236e3b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b', 'volume_size': 1} Sep 28 15:21:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa 1073741824" returned: 0 in 0.558s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa Sep 28 15:21:21 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (930317a4-95d8-4296-8842-5153d239db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be960a34-c4df-4319-a496-1af7d5f01a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be960a34-c4df-4319-a496-1af7d5f01a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803733644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a983c73b-eb59-498a-ae31-4a665554bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:21Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793f467-7492-4c54-b70f-4a9472dc9b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793f467-7492-4c54-b70f-4a9472dc9b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81cde14-42ef-464d-b22b-602713676e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81cde14-42ef-464d-b22b-602713676e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a983c73b-eb59-498a-ae31-4a665554bb09', 'volume_name': 'volume-a983c73b-eb59-498a-ae31-4a665554bb09', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fa29ec-dfb5-4e58-a244-ea8b694fede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fa29ec-dfb5-4e58-a244-ea8b694fede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e836f-2c53-44e8-b9b0-d76deeb25543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume a983c73b-eb59-498a-ae31-4a665554bb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a983c73b-eb59-498a-ae31-4a665554bb09', 'volume_size': 1} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa" returned: 0 in 0.305s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289938554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a76864-8d2a-4cf5-b2da-c930236e3b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:21Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Creating volume 56a76864-8d2a-4cf5-b2da-c930236e3b7b {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:21 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b 1073741824 Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9b12b6-57cf-465c-bdf3-83fb2557c287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cc2daa-bf24-4bdd-947d-696c582689aa', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e1816a-67ee-42ba-81ec-8361107f9f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume volume-f2cc2daa-bf24-4bdd-947d-696c582689aa (f2cc2daa-bf24-4bdd-947d-696c582689aa): created successfully Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e1816a-67ee-42ba-81ec-8361107f9f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (c6550ee7-4fb7-4545-aca6-3c8d2a82bba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ba6ff04c-506c-41b1-b7d4-1732009c5ba1 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created volume successfully. Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (6bcc8f61-a28b-4798-9c26-7e04aab24a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440abc39-81e2-4e56-ac7e-952e261a30ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440abc39-81e2-4e56-ac7e-952e261a30ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810765260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2922b8-fa5f-419a-94a2-f960eb014354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:22Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67fc36-3340-4d35-834a-0a1040867836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67fc36-3340-4d35-834a-0a1040867836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cabd5f-93fd-45d8-ac3d-08a5822a043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cabd5f-93fd-45d8-ac3d-08a5822a043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2922b8-fa5f-419a-94a2-f960eb014354', 'volume_name': 'volume-cc2922b8-fa5f-419a-94a2-f960eb014354', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa72ca3d-0a1d-462e-accb-2c76769513d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa72ca3d-0a1d-462e-accb-2c76769513d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523e4204-884d-48dd-8d25-85a2fd94b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume cc2922b8-fa5f-419a-94a2-f960eb014354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2922b8-fa5f-419a-94a2-f960eb014354', 'volume_size': 1} Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b 1073741824" returned: 0 in 0.573s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (2774d4d7-5631-41d5-b240-5dc8c57c02ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066260d8-d854-4697-9981-951cdbf78906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b Sep 28 15:21:22 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066260d8-d854-4697-9981-951cdbf78906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1088284935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bec44c2-7ed4-4e05-88b5-6c1336b4b51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:22Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74acd0e-9b33-47c1-93ab-28b5c9483826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74acd0e-9b33-47c1-93ab-28b5c9483826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1df03a0-9b03-4f61-abc0-f7e1eaf7eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1df03a0-9b03-4f61-abc0-f7e1eaf7eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bec44c2-7ed4-4e05-88b5-6c1336b4b51e', 'volume_name': 'volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2895dcf0-db05-46bf-bc6c-331524b93ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2895dcf0-db05-46bf-bc6c-331524b93ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e6fb7d-d38e-495c-ab51-22f7bfe6f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:22 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume 1bec44c2-7ed4-4e05-88b5-6c1336b4b51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e', 'volume_size': 1} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:22 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b" returned: 0 in 0.242s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803733644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a983c73b-eb59-498a-ae31-4a665554bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:21Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Creating volume a983c73b-eb59-498a-ae31-4a665554bb09 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:22 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f0aea-5289-4962-8f23-f9dd1f7e3557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 1073741824 Sep 28 15:21:22 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014f6475-b064-4cce-8184-a2ea439dd9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:22 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b (56a76864-8d2a-4cf5-b2da-c930236e3b7b): created successfully Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014f6475-b064-4cce-8184-a2ea439dd9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (d52b71de-c450-4a5a-8706-03b397bf48b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:22 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-70be7dc4-cc6f-4e46-b5e8-8f7dc5193d45 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created volume successfully. Sep 28 15:21:22 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 1073741824" returned: 0 in 0.442s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 Sep 28 15:21:22 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09" returned: 0 in 0.258s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810765260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2922b8-fa5f-419a-94a2-f960eb014354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:22Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Creating volume cc2922b8-fa5f-419a-94a2-f960eb014354 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:23 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e836f-2c53-44e8-b9b0-d76deeb25543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a983c73b-eb59-498a-ae31-4a665554bb09', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 1073741824 Sep 28 15:21:23 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37e9bca-dc78-482a-96b2-17eb9802cf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:23 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume volume-a983c73b-eb59-498a-ae31-4a665554bb09 (a983c73b-eb59-498a-ae31-4a665554bb09): created successfully Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37e9bca-dc78-482a-96b2-17eb9802cf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (930317a4-95d8-4296-8842-5153d239db70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-da2026c2-e26c-4de0-b864-b9e7b497b616 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created volume successfully. Sep 28 15:21:23 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 1073741824" returned: 0 in 0.423s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:23 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 Sep 28 15:21:23 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354" returned: 0 in 0.234s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1088284935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bec44c2-7ed4-4e05-88b5-6c1336b4b51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff1cefa166e445478bffebc92ea6ddfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:22Z,use_quota=True,user_id='3ef8125e802f4d3bb31aafed681ca2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Creating volume 1bec44c2-7ed4-4e05-88b5-6c1336b4b51e {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:23 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:23 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e 1073741824 Sep 28 15:21:23 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523e4204-884d-48dd-8d25-85a2fd94b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2922b8-fa5f-419a-94a2-f960eb014354', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7141622-835f-48b8-a509-4f9842f7f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:23 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume volume-cc2922b8-fa5f-419a-94a2-f960eb014354 (cc2922b8-fa5f-419a-94a2-f960eb014354): created successfully Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7141622-835f-48b8-a509-4f9842f7f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (6bcc8f61-a28b-4798-9c26-7e04aab24a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1a198fd8-f3f0-411b-8308-992537598026 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created volume successfully. Sep 28 15:21:24 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e 1073741824" returned: 0 in 0.457s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:24 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e Sep 28 15:21:24 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:24 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e" returned: 0 in 0.239s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e6fb7d-d38e-495c-ab51-22f7bfe6f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d49d7e-fcf7-453a-bdb2-b35bc63bdb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:24 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Volume volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e (1bec44c2-7ed4-4e05-88b5-6c1336b4b51e): created successfully Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d49d7e-fcf7-453a-bdb2-b35bc63bdb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Flow 'volume_create_manager' (2774d4d7-5631-41d5-b240-5dc8c57c02ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-92c0bd9f-dde0-4614-a1cc-705dcccff5d8 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created volume successfully. Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-quobyte-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3f9e7d-3cda-4be6-97a0-cb20e907c50e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:25 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e Sep 28 15:21:25 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:25 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e" returned: 0 in 0.379s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:25 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e Sep 28 15:21:25 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:26 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e" returned: 0 in 0.263s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e" released by "delete_volume" :: held 0.689s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created reservations ['448a86fb-ae9d-4b6a-8626-1c563b3cc383', '20a4eeee-9246-4d1c-8c55-7f4442beb40c', '44af5556-5385-42a2-aeec-58a7523766fe', 'a8f0cbf9-e2b8-4c13-b2be-7615e17d6f73'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:26 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:26 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:26 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.254s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:26 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Deleted volume successfully. Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c72a54a3-b868-4fa4-81a6-6844c18e7e3e tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-1bec44c2-7ed4-4e05-88b5-6c1336b4b51e-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-cc2922b8-fa5f-419a-94a2-f960eb014354-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-cc2922b8-fa5f-419a-94a2-f960eb014354-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-quobyte-cc2922b8-fa5f-419a-94a2-f960eb014354" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-cc2922b8-fa5f-419a-94a2-f960eb014354" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc09ae40-032f-4053-acc9-ac42c1a2cfb0]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:26 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 Sep 28 15:21:26 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:27 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354" returned: 0 in 0.396s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:27 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354 Sep 28 15:21:27 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:27 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cc2922b8-fa5f-419a-94a2-f960eb014354" returned: 0 in 0.263s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-cc2922b8-fa5f-419a-94a2-f960eb014354" released by "delete_volume" :: held 0.708s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created reservations ['a798ecd6-076b-4b8f-abb4-f8a72fbf57c8', 'b940f8c7-f52b-4eb3-8c31-072af1547f81', '47672642-76fb-492f-8495-7f6d3e240f02', 'cb4a2064-6bd7-4ed6-b3d6-cc81bc8f7470'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:27 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:27 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-a983c73b-eb59-498a-ae31-4a665554bb09-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:27 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.299s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:27 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Deleted volume successfully. Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-a983c73b-eb59-498a-ae31-4a665554bb09-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7ab4c5d1-0cb3-48d6-9338-49ff4f8428f9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-cc2922b8-fa5f-419a-94a2-f960eb014354-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-quobyte-a983c73b-eb59-498a-ae31-4a665554bb09" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-a983c73b-eb59-498a-ae31-4a665554bb09" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c16351-aa66-4341-a332-94fbfbaa795d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:28 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 Sep 28 15:21:28 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:28 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09" returned: 0 in 0.385s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:28 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09 Sep 28 15:21:28 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:28 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a983c73b-eb59-498a-ae31-4a665554bb09" returned: 0 in 0.273s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-a983c73b-eb59-498a-ae31-4a665554bb09" released by "delete_volume" :: held 0.707s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created reservations ['df53c5d1-6179-4c9e-b3a0-9321041d8df0', '6233786a-e342-47d8-96f9-57cd9c7ad4e2', '0851730e-11e9-462c-9331-ec5527adeae5', '2d537acf-f8c9-4f46-9658-29d1adaff6ef'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:28 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:28 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-56a76864-8d2a-4cf5-b2da-c930236e3b7b-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-56a76864-8d2a-4cf5-b2da-c930236e3b7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:29 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.294s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Deleted volume successfully. Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-quobyte-56a76864-8d2a-4cf5-b2da-c930236e3b7b" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a41fd588-6c76-4c94-b38e-9272e333b635 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-a983c73b-eb59-498a-ae31-4a665554bb09-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-56a76864-8d2a-4cf5-b2da-c930236e3b7b" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8454ab6-e0a4-4488-981f-576d1b1edba7]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:29 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b Sep 28 15:21:29 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:29 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b" returned: 0 in 0.381s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:29 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b Sep 28 15:21:29 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:29 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-56a76864-8d2a-4cf5-b2da-c930236e3b7b" returned: 0 in 0.283s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-56a76864-8d2a-4cf5-b2da-c930236e3b7b" released by "delete_volume" :: held 0.714s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created reservations ['f24ee4ee-5516-4551-90dd-ebd4b0f9248f', '4c2077fd-9385-4526-a281-64e5b543d178', '36201c25-11d6-4632-a8a5-5e2654758454', 'd2b0594c-c03a-4ffa-b9c4-bf308aaf8b71'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:29 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:29 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-f2cc2daa-bf24-4bdd-947d-696c582689aa-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-f2cc2daa-bf24-4bdd-947d-696c582689aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:30 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.320s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-quobyte-f2cc2daa-bf24-4bdd-947d-696c582689aa" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:30 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Deleted volume successfully. Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-f2cc2daa-bf24-4bdd-947d-696c582689aa" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ae17279-5701-4737-ab07-f83f2eae74e9 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-56a76864-8d2a-4cf5-b2da-c930236e3b7b-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c45f315-75f8-4472-bf88-0674fd687348]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:30 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa Sep 28 15:21:30 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa" returned: 0 in 0.407s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:30 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa Sep 28 15:21:30 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f2cc2daa-bf24-4bdd-947d-696c582689aa" returned: 0 in 0.250s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-f2cc2daa-bf24-4bdd-947d-696c582689aa" released by "delete_volume" :: held 0.714s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created reservations ['3a4ef223-ef79-4e59-8f6a-4bd14d19e1ca', 'ee625474-7065-42fe-801a-1f65907aa6a3', 'b875cb87-1d6b-49e0-b329-b67fb2fa6987', '1a57d240-34b6-44e0-842a-f06b5db7079d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:31 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:31 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-58df9881-6959-47ef-91bc-f77f0b0a2949-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:31 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.274s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-58df9881-6959-47ef-91bc-f77f0b0a2949-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Deleted volume successfully. Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-533999ad-0c75-45a6-9839-10c6b7155608 tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-f2cc2daa-bf24-4bdd-947d-696c582689aa-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "cinder-quobyte-58df9881-6959-47ef-91bc-f77f0b0a2949" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-58df9881-6959-47ef-91bc-f77f0b0a2949" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[10410306-ce9c-4498-840d-be0261bf8598]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:31 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 Sep 28 15:21:31 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:31 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949" returned: 0 in 0.386s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:31 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949 Sep 28 15:21:31 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:32 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-58df9881-6959-47ef-91bc-f77f0b0a2949" returned: 0 in 0.248s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-quobyte-58df9881-6959-47ef-91bc-f77f0b0a2949" released by "delete_volume" :: held 0.679s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Created reservations ['32cc16e8-4486-4b8d-a1de-99800c55eeee', '6655d78c-2697-4c1e-af43-18d4d5674a0b', 'b093ebc5-9d6b-495c-a048-03b4f0b52254', '175b687c-9d12-45a9-85e8-60563aa31f43'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:32 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:32 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:32 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.257s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:32 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Deleted volume successfully. Sep 28 15:21:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-51dbb33d-a24d-4546-8b84-955ab4c61c3a tempest-CreateVolumesFromSourceVolumeTest-1979163632 None] Lock "cinder-58df9881-6959-47ef-91bc-f77f0b0a2949-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:33 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:33 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:34 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.288s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:21:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Flow 'volume_create_manager' (fa4c7e73-8977-4ede-9835-5b7e9a9bd18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573f4e10-e40a-49e3-96e7-a2b47faf399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573f4e10-e40a-49e3-96e7-a2b47faf399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ab748e-32bb-49ee-8673-67874e33ea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f20c799764a3eb9e0680de493a8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:38Z,use_quota=True,user_id='ece632b0c58d424e896039f7cf9dfcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6eedfa6-7ab3-4dbc-a00b-6a001e8be13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6eedfa6-7ab3-4dbc-a00b-6a001e8be13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd14f854-b47c-4f70-9ea6-a53778ee528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:37 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd14f854-b47c-4f70-9ea6-a53778ee528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9ab748e-32bb-49ee-8673-67874e33ea0b', 'volume_name': 'volume-f9ab748e-32bb-49ee-8673-67874e33ea0b', 'volume_size': 1, 'image_id': '8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2a908d7c6226bcea3926784411de730', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '185f20c799764a3eb9e0680de493a8a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '537f45bea00dce08db092eb156f9b82a423db8241baa05a215f11457cbc016c967adf282caa8d127ed2dd532e0dd7cf3a9ee3d8b7312eefe30a43a14a5d495b3', 'id': '8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3/file', 'properties': {}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1a7051-d9b9-4c77-b71f-7f979b125a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1a7051-d9b9-4c77-b71f-7f979b125a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e069292e-28a0-4110-83fd-51d5e8230bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:38 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Volume f9ab748e-32bb-49ee-8673-67874e33ea0b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9ab748e-32bb-49ee-8673-67874e33ea0b', 'volume_size': 1, 'image_id': '8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2a908d7c6226bcea3926784411de730', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '185f20c799764a3eb9e0680de493a8a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '537f45bea00dce08db092eb156f9b82a423db8241baa05a215f11457cbc016c967adf282caa8d127ed2dd532e0dd7cf3a9ee3d8b7312eefe30a43a14a5d495b3', 'id': '8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3/file', 'properties': {}}, 'image_service': } Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Trying to clone f9ab748e-32bb-49ee-8673-67874e33ea0b from image 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:21:38 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f8e2ae-3c8f-4dc4-8c03-61c0796670c5]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:38 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD Sep 28 15:21:38 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:38 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:38 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD Sep 28 15:21:38 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:39 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Temporary image 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 is fetched for user ece632b0c58d424e896039f7cf9dfcaf. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a870a-e78e-49da-a166-e666770c1754]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:39 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD Sep 28 15:21:39 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:39 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:39 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD Sep 28 15:21:39 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:39 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD" returned: 1 in 0.310s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ab748e-32bb-49ee-8673-67874e33ea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f20c799764a3eb9e0680de493a8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:38Z,use_quota=True,user_id='ece632b0c58d424e896039f7cf9dfcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Creating volume f9ab748e-32bb-49ee-8673-67874e33ea0b {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:39 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b 1073741824 Sep 28 15:21:39 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:40 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b 1073741824" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:40 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b Sep 28 15:21:40 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:40 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b" returned: 0 in 0.254s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Attempting download of 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'metadata': {}}])) to volume f9ab748e-32bb-49ee-8673-67874e33ea0b. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dcb9d6-2aaa-4373-aa8f-138e440f2a81]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3__acxdiz6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:40 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3__acxdiz6 Sep 28 15:21:40 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:40 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3__acxdiz6" returned: 0 in 0.343s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3__acxdiz6 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:41 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3__acxdiz6 Sep 28 15:21:41 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:41 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3__acxdiz6" returned: 1 in 0.339s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3__acxdiz6' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c5c599-b237-4ddf-967d-268ef0b5b56a]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:41 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD Sep 28 15:21:41 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:41 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:41 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD Sep 28 15:21:41 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:41 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD" returned: 1 in 0.328s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 was raw, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:21:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:41 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b Sep 28 15:21:41 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:42 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b" returned: 0 in 0.435s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8cbbb3ea-6a93-47d8-9a4d-ca28086812a3_8ff_0z59devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:21:42 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:42 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b 1G Sep 28 15:21:42 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:42 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b 1G" returned: 0 in 0.319s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Downloaded image 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'metadata': {}}])) to volume f9ab748e-32bb-49ee-8673-67874e33ea0b successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Temporary image 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 for user ece632b0c58d424e896039f7cf9dfcaf is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Marking volume f9ab748e-32bb-49ee-8673-67874e33ea0b as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Copying metadata from image 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 to f9ab748e-32bb-49ee-8673-67874e33ea0b. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Creating volume glance metadata for volume f9ab748e-32bb-49ee-8673-67874e33ea0b backed by image 8cbbb3ea-6a93-47d8-9a4d-ca28086812a3 with: {'image_id': '8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b2a908d7c6226bcea3926784411de730', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e069292e-28a0-4110-83fd-51d5e8230bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ab748e-32bb-49ee-8673-67874e33ea0b', 'volume_size': 1, 'image_id': '8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2a908d7c6226bcea3926784411de730', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '185f20c799764a3eb9e0680de493a8a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '537f45bea00dce08db092eb156f9b82a423db8241baa05a215f11457cbc016c967adf282caa8d127ed2dd532e0dd7cf3a9ee3d8b7312eefe30a43a14a5d495b3', 'id': '8cbbb3ea-6a93-47d8-9a4d-ca28086812a3', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cbbb3ea-6a93-47d8-9a4d-ca28086812a3/file', 'properties': {}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562777de-815a-4bff-9bdd-692155c8f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Volume volume-f9ab748e-32bb-49ee-8673-67874e33ea0b (f9ab748e-32bb-49ee-8673-67874e33ea0b): created successfully Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562777de-815a-4bff-9bdd-692155c8f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Flow 'volume_create_manager' (fa4c7e73-8977-4ede-9835-5b7e9a9bd18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b8586b62-d608-45af-82c0-126243bd9479 tempest-VolumeImageDependencyTests-166140814 None] Created volume successfully. Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Acquiring lock "cinder-f9ab748e-32bb-49ee-8673-67874e33ea0b-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Lock "cinder-f9ab748e-32bb-49ee-8673-67874e33ea0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Acquiring lock "cinder-quobyte-f9ab748e-32bb-49ee-8673-67874e33ea0b" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Lock "cinder-quobyte-f9ab748e-32bb-49ee-8673-67874e33ea0b" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd0a84-103b-47b2-b21a-f41a1a1da873]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:43 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b Sep 28 15:21:43 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:43 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b" returned: 0 in 0.370s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:43 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b Sep 28 15:21:43 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:43 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f9ab748e-32bb-49ee-8673-67874e33ea0b" returned: 0 in 0.243s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Lock "cinder-quobyte-f9ab748e-32bb-49ee-8673-67874e33ea0b" released by "delete_volume" :: held 0.660s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Created reservations ['7fb057e8-b1cf-43d7-893e-3d85020a248d', '33f1ece6-be6e-4a0a-809c-5f423fdec362', 'dd990586-1f7c-493f-9fee-522efcfb1590', 'aeccebef-f655-41e7-b4d7-b33ef2c18276'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:44 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:21:44 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:44 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.239s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:44 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Deleted volume successfully. Sep 28 15:21:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e7bf81e5-f7df-4914-9fc9-bcf59d0598e4 tempest-VolumeImageDependencyTests-166140814 None] Lock "cinder-f9ab748e-32bb-49ee-8673-67874e33ea0b-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:53 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=82,cinder:SELECT=54,cinder:DELETE=5,cinder:INSERT=22 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:54 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=55,cinder:INSERT=22,cinder:UPDATE=75,cinder:DELETE=9 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (ce704324-d194-434b-af6f-c7908f6aedae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c8b579-e2e4-4bf7-9da5-63f6eb29b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c8b579-e2e4-4bf7-9da5-63f6eb29b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27947623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d81caad-dd07-42e7-a370-7a2ec4be98b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:57Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac2c65b-ab5b-4b0b-b92d-e717d590f4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac2c65b-ab5b-4b0b-b92d-e717d590f4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8881bce4-f4d9-47e0-87a4-e2a9e79784e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8881bce4-f4d9-47e0-87a4-e2a9e79784e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d81caad-dd07-42e7-a370-7a2ec4be98b4', 'volume_name': 'volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22921e4-8cd2-41c2-8470-6311131541e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22921e4-8cd2-41c2-8470-6311131541e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddda3aa-771e-4954-8ec8-9a50cc9cb23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Volume 6d81caad-dd07-42e7-a370-7a2ec4be98b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4', 'volume_size': 1} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27947623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d81caad-dd07-42e7-a370-7a2ec4be98b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:57Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Creating volume 6d81caad-dd07-42e7-a370-7a2ec4be98b4 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:57 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 1073741824 Sep 28 15:21:57 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Flow 'volume_create_manager' (39e0520d-4f1c-4a5f-81f2-eed3fa801225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c1189a-63c1-4497-a9a2-6ee322833052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c1189a-63c1-4497-a9a2-6ee322833052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1418563652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc238ce-774c-46e0-8e94-48854d670ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0984b0d2f4414bdd9cc459acc57f198f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:57Z,use_quota=True,user_id='245ac280d5a94789951bd15a202d461c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d078026-13cb-4dc3-83f1-4fd2ea523a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d078026-13cb-4dc3-83f1-4fd2ea523a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faae8f2e-c85e-4acb-91a8-95302912ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faae8f2e-c85e-4acb-91a8-95302912ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc238ce-774c-46e0-8e94-48854d670ca2', 'volume_name': 'volume-1bc238ce-774c-46e0-8e94-48854d670ca2', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f6c980-11d9-48ae-b05b-c6743d17ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f6c980-11d9-48ae-b05b-c6743d17ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c4bcc1-ba4b-4837-ba7c-6732d17222e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Volume 1bc238ce-774c-46e0-8e94-48854d670ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc238ce-774c-46e0-8e94-48854d670ca2', 'volume_size': 1} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (ebc455f8-8030-417e-a130-97d6edc0cdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eac0414-1da0-4fdb-ae4d-888556990305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eac0414-1da0-4fdb-ae4d-888556990305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-850223416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073defd1-1b55-486c-b36d-a00bdabc0391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:58Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2002da71-a14c-4db5-b981-b36e647264c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2002da71-a14c-4db5-b981-b36e647264c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cd7d20-fd0c-4953-b0db-cacfe86f29d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cd7d20-fd0c-4953-b0db-cacfe86f29d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073defd1-1b55-486c-b36d-a00bdabc0391', 'volume_name': 'volume-073defd1-1b55-486c-b36d-a00bdabc0391', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc86c82-62ed-4b3a-92b6-7e18beb3f30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc86c82-62ed-4b3a-92b6-7e18beb3f30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0d9d52-9263-44e0-8c1c-d61aa29f3257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Volume 073defd1-1b55-486c-b36d-a00bdabc0391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073defd1-1b55-486c-b36d-a00bdabc0391', 'volume_size': 1} Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:57 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 1073741824" returned: 0 in 0.693s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (cc048646-591a-4b8a-9c49-ebccaf30501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d309b91e-a014-41a4-8467-65de021dd8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d309b91e-a014-41a4-8467-65de021dd8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061045197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f53ce20-1afa-45b7-bf73-0b2506516537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:58Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 Sep 28 15:21:58 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b5d89b-f74b-43b6-9377-991762b78303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b5d89b-f74b-43b6-9377-991762b78303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c58ed97-e4e2-44a0-87a3-44d58fb30897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c58ed97-e4e2-44a0-87a3-44d58fb30897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f53ce20-1afa-45b7-bf73-0b2506516537', 'volume_name': 'volume-1f53ce20-1afa-45b7-bf73-0b2506516537', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7380d7e3-ad90-4b39-9698-50757014c53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7380d7e3-ad90-4b39-9698-50757014c53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45cec75-bd95-4d53-9a81-ec859b2a3ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume 1f53ce20-1afa-45b7-bf73-0b2506516537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f53ce20-1afa-45b7-bf73-0b2506516537', 'volume_size': 1} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:58 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4" returned: 0 in 0.341s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1418563652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc238ce-774c-46e0-8e94-48854d670ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0984b0d2f4414bdd9cc459acc57f198f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:57Z,use_quota=True,user_id='245ac280d5a94789951bd15a202d461c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Creating volume 1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:58 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddda3aa-771e-4954-8ec8-9a50cc9cb23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 1073741824 Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b08b071-8ccb-4b0a-8f54-df91a61da384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (37598953-4e47-482c-b72b-2a1439499429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27477f3-89ac-49ca-b218-74cc2d0d23fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Volume volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 (6d81caad-dd07-42e7-a370-7a2ec4be98b4): created successfully Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b08b071-8ccb-4b0a-8f54-df91a61da384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (ce704324-d194-434b-af6f-c7908f6aedae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27477f3-89ac-49ca-b218-74cc2d0d23fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703822454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f339369-7bd4-40e7-9eac-38dd13ffa01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:58Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d666cb09-d4b8-4e3f-8bae-90a061d67651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d666cb09-d4b8-4e3f-8bae-90a061d67651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a85f24d-9ca2-4cd6-8dec-843a812c0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a85f24d-9ca2-4cd6-8dec-843a812c0075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f339369-7bd4-40e7-9eac-38dd13ffa01f', 'volume_name': 'volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0dfe8-daa9-45ed-a1d3-ddf202876395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0dfe8-daa9-45ed-a1d3-ddf202876395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212346b9-181b-4778-b4ce-01acd77208ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Volume 1f339369-7bd4-40e7-9eac-38dd13ffa01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f', 'volume_size': 1} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6b680b34-1a1f-4eac-ad17-0cc67d69cdd0 tempest-CreateVolumesFromImageTest-204735912 None] Created volume successfully. Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (4faf6079-ba15-429d-8d29-fbf1b225fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36966e68-6abe-42d3-abdb-37b2533251cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36966e68-6abe-42d3-abdb-37b2533251cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1200442802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545cd50e-fc3c-4d5f-91aa-4057d52edacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:59Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8214085e-1910-4cb6-863e-ede8866ca3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8214085e-1910-4cb6-863e-ede8866ca3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378a2599-9676-4984-a41b-772cc78b437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378a2599-9676-4984-a41b-772cc78b437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545cd50e-fc3c-4d5f-91aa-4057d52edacc', 'volume_name': 'volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006078bd-ac3d-45dd-b34c-bee4e9af5ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006078bd-ac3d-45dd-b34c-bee4e9af5ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72530627-ec85-459d-8fd8-ad45e1dc3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Volume 545cd50e-fc3c-4d5f-91aa-4057d52edacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc', 'volume_size': 1} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:59 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 1073741824" returned: 0 in 0.677s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:59 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 Sep 28 15:21:59 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (f37789a0-767a-439d-8060-6376789e3302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a35d0c-8074-47b6-8353-16fac489dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a35d0c-8074-47b6-8353-16fac489dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408499278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164b64b8-e856-4f56-93c1-b775cd496b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:59Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93f06ad-388e-4c83-b75e-8076df9d858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93f06ad-388e-4c83-b75e-8076df9d858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db5d0a6-069c-4123-b94d-6ac0b8b77285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db5d0a6-069c-4123-b94d-6ac0b8b77285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164b64b8-e856-4f56-93c1-b775cd496b42', 'volume_name': 'volume-164b64b8-e856-4f56-93c1-b775cd496b42', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2870d14-3e90-40ec-ad98-e93a8febd857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2870d14-3e90-40ec-ad98-e93a8febd857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7289881-be7c-44c3-87a7-225f074ee3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Volume 164b64b8-e856-4f56-93c1-b775cd496b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164b64b8-e856-4f56-93c1-b775cd496b42', 'volume_size': 1} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2" returned: 0 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-850223416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073defd1-1b55-486c-b36d-a00bdabc0391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:58Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Creating volume 073defd1-1b55-486c-b36d-a00bdabc0391 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:59 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c4bcc1-ba4b-4837-ba7c-6732d17222e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc238ce-774c-46e0-8e94-48854d670ca2', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 1073741824 Sep 28 15:21:59 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76d600f-b773-4fb0-a32e-c158beda9345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Volume volume-1bc238ce-774c-46e0-8e94-48854d670ca2 (1bc238ce-774c-46e0-8e94-48854d670ca2): created successfully Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76d600f-b773-4fb0-a32e-c158beda9345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Flow 'volume_create_manager' (39e0520d-4f1c-4a5f-81f2-eed3fa801225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1e6e683a-263b-4c26-8e27-d6efb2373f7f tempest-VolumeDependencyTests-336180652 None] Created volume successfully. Sep 28 15:22:00 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 1073741824" returned: 0 in 0.525s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:00 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 Sep 28 15:22:00 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391" returned: 0 in 0.265s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.289s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061045197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f53ce20-1afa-45b7-bf73-0b2506516537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:58Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Creating volume 1f53ce20-1afa-45b7-bf73-0b2506516537 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:00 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0d9d52-9263-44e0-8c1c-d61aa29f3257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073defd1-1b55-486c-b36d-a00bdabc0391', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:00 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 1073741824 Sep 28 15:22:00 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee65a6a-17cc-4c6e-878f-4767e9d49a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:00 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Volume volume-073defd1-1b55-486c-b36d-a00bdabc0391 (073defd1-1b55-486c-b36d-a00bdabc0391): created successfully Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee65a6a-17cc-4c6e-878f-4767e9d49a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (ebc455f8-8030-417e-a130-97d6edc0cdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6a665398-fa6a-426b-93d0-d115f4370547 tempest-CreateVolumesFromImageTest-204735912 None] Created volume successfully. Sep 28 15:22:00 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 1073741824" returned: 0 in 0.518s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 Sep 28 15:22:01 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:01 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537" returned: 0 in 0.255s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.626s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703822454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f339369-7bd4-40e7-9eac-38dd13ffa01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:58Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Creating volume 1f339369-7bd4-40e7-9eac-38dd13ffa01f {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45cec75-bd95-4d53-9a81-ec859b2a3ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f53ce20-1afa-45b7-bf73-0b2506516537', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f 1073741824 Sep 28 15:22:01 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd56f9b-abd1-40fa-a6c5-9a61534c4229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume volume-1f53ce20-1afa-45b7-bf73-0b2506516537 (1f53ce20-1afa-45b7-bf73-0b2506516537): created successfully Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd56f9b-abd1-40fa-a6c5-9a61534c4229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (cc048646-591a-4b8a-9c49-ebccaf30501d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:01 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-233be5b7-840c-4181-b5dd-7d6c335dd396 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created volume successfully. Sep 28 15:22:01 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f 1073741824" returned: 0 in 0.569s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f Sep 28 15:22:01 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Flow 'volume_create_manager' (f4dedb2b-9e9b-4920-95e7-8ba1b776fea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e535cae0-6415-4528-9ace-c32e9abdc203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e535cae0-6415-4528-9ace-c32e9abdc203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba44d1ee36c44b6a248b7514bc37845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:02Z,use_quota=True,user_id='7eb20b2d2fbf4a4ebb72b7d6f90ba778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a1ec7f6-3def-49bf-948f-2c74a3d49415),volume_type_id=7a1ec7f6-3def-49bf-948f-2c74a3d49415)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24b25bf-2e0f-4ffa-a7fd-f0795982155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24b25bf-2e0f-4ffa-a7fd-f0795982155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cf435c-013b-46a5-807b-d44e11393952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:22:02 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f" returned: 0 in 0.290s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.160s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1200442802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545cd50e-fc3c-4d5f-91aa-4057d52edacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:59Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Creating volume 545cd50e-fc3c-4d5f-91aa-4057d52edacc {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:02 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:02 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc 1073741824 Sep 28 15:22:02 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212346b9-181b-4778-b4ce-01acd77208ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce094e-2c9f-4ee6-99ef-5e610cd1f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Volume volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f (1f339369-7bd4-40e7-9eac-38dd13ffa01f): created successfully Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce094e-2c9f-4ee6-99ef-5e610cd1f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (37598953-4e47-482c-b72b-2a1439499429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-bf483aea-4170-4a7e-877d-c158f83bef1e tempest-CreateVolumesFromImageTest-204735912 None] Created volume successfully. Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cf435c-013b-46a5-807b-d44e11393952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222', 'volume_name': 'volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222', 'volume_size': 1, 'image_id': '7db21517-bbfa-4926-94d2-d016d323c0f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7db21517-bbfa-4926-94d2-d016d323c0f7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b53338470df3a5ac88e45beb893c784a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ba44d1ee36c44b6a248b7514bc37845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c56aa104d16ddf04b7fb8e912ea0b68d186e86e72ea51ff93375c1835d23e9c297c81537863cd6ebd6857150f2f9d125dc229b6320e346749460c01ccf749f2', 'id': '7db21517-bbfa-4926-94d2-d016d323c0f7', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7db21517-bbfa-4926-94d2-d016d323c0f7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f20fa2-faef-4926-9810-4d63a5744c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f20fa2-faef-4926-9810-4d63a5744c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132b6390-6a45-40aa-8347-fff55b8755da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Volume 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222', 'volume_size': 1, 'image_id': '7db21517-bbfa-4926-94d2-d016d323c0f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7db21517-bbfa-4926-94d2-d016d323c0f7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b53338470df3a5ac88e45beb893c784a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ba44d1ee36c44b6a248b7514bc37845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c56aa104d16ddf04b7fb8e912ea0b68d186e86e72ea51ff93375c1835d23e9c297c81537863cd6ebd6857150f2f9d125dc229b6320e346749460c01ccf749f2', 'id': '7db21517-bbfa-4926-94d2-d016d323c0f7', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7db21517-bbfa-4926-94d2-d016d323c0f7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Trying to clone 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 from image 7db21517-bbfa-4926-94d2-d016d323c0f7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7db21517-bbfa-4926-94d2-d016d323c0f7', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:22:02 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9500840e-9d56-45ad-8530-be8ef6a30f7b]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:02 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD Sep 28 15:22:02 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:02 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc 1073741824" returned: 0 in 0.669s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (b169c160-3933-4d08-8213-c8bf5bd3bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228e4d94-2762-4d92-988e-71d72070797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228e4d94-2762-4d92-988e-71d72070797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670723771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7835494-16e4-4ec0-85fc-87ba55620d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:03Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da542f10-4363-411f-9fb0-35180d022243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc Sep 28 15:22:03 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da542f10-4363-411f-9fb0-35180d022243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6065b9e-ed47-4521-8aac-5f629680e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6065b9e-ed47-4521-8aac-5f629680e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7835494-16e4-4ec0-85fc-87ba55620d06', 'volume_name': 'volume-b7835494-16e4-4ec0-85fc-87ba55620d06', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f7e1b3-858f-4662-9f60-53724ccd0cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f7e1b3-858f-4662-9f60-53724ccd0cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b2ea69-aad6-42b5-8993-824c9a128950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume b7835494-16e4-4ec0-85fc-87ba55620d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7835494-16e4-4ec0-85fc-87ba55620d06', 'volume_size': 1} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:03 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD Sep 28 15:22:03 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc" returned: 0 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.738s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408499278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164b64b8-e856-4f56-93c1-b775cd496b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b964a9ddc72c4e48b72649b7b641859e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:59Z,use_quota=True,user_id='c5c80cba91254d2d8f0500dbfeb80e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Creating volume 164b64b8-e856-4f56-93c1-b775cd496b42 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:03 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:03 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 1073741824 Sep 28 15:22:03 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72530627-ec85-459d-8fd8-ad45e1dc3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13955621-6280-4485-8911-dd6b711213a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (70806192-44f2-4744-98fb-01541a7955de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca51e8-5d0f-41bd-aad2-c6d63d1e6982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Volume volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc (545cd50e-fc3c-4d5f-91aa-4057d52edacc): created successfully Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13955621-6280-4485-8911-dd6b711213a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (4faf6079-ba15-429d-8d29-fbf1b225fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca51e8-5d0f-41bd-aad2-c6d63d1e6982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1730781688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a067ab-43c9-4590-a6cc-653133eadacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:03Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc9a824-26ea-4b59-b9e4-b66de6c991bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc9a824-26ea-4b59-b9e4-b66de6c991bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca2a3fc-63ab-4e01-99e7-509b305adedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca2a3fc-63ab-4e01-99e7-509b305adedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13a067ab-43c9-4590-a6cc-653133eadacb', 'volume_name': 'volume-13a067ab-43c9-4590-a6cc-653133eadacb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d9f60f-2e4d-4261-b386-c19a9dda638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d9f60f-2e4d-4261-b386-c19a9dda638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f24b106-3fe3-4647-a84c-6a2ad3077c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume 13a067ab-43c9-4590-a6cc-653133eadacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13a067ab-43c9-4590-a6cc-653133eadacb', 'volume_size': 1} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:03 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f448ce8c-02b6-4b12-8413-0b7097482f97 tempest-CreateVolumesFromImageTest-204735912 None] Created volume successfully. Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD" returned: 1 in 0.547s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Temporary image 7db21517-bbfa-4926-94d2-d016d323c0f7 is fetched for user 7eb20b2d2fbf4a4ebb72b7d6f90ba778. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37c8fe5-5b3e-4eb6-84f6-cb5ad2d71fa9]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:03 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD Sep 28 15:22:03 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (7a55f54e-a25a-47b3-8103-b40590ff283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3d9f1a-d08b-4717-b020-1318a4a729a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3d9f1a-d08b-4717-b020-1318a4a729a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1976590506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7c5e98-00ab-4a63-9bd8-4067005f8e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:04Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9b9056-5b9a-4090-9e58-d2b0c9b6e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9b9056-5b9a-4090-9e58-d2b0c9b6e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022c5692-1c4a-4bfd-a910-ebbbacf6df29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022c5692-1c4a-4bfd-a910-ebbbacf6df29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7c5e98-00ab-4a63-9bd8-4067005f8e1e', 'volume_name': 'volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d09c26e-8230-497f-b52a-2fcb9eca1699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d09c26e-8230-497f-b52a-2fcb9eca1699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d7a9a6-0381-4420-a77a-9686812fd676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume 1c7c5e98-00ab-4a63-9bd8-4067005f8e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e', 'volume_size': 1} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:04 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 1073741824" returned: 0 in 0.841s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:04 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 Sep 28 15:22:04 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:04 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:04 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD Sep 28 15:22:04 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (757bf88f-8912-4913-a967-1113516bfee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bf346c-4108-4389-81b9-3a15dda5baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bf346c-4108-4389-81b9-3a15dda5baf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409724663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd5ad5d-8446-4b4a-a41d-7090ae14159a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:04Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e030a9fb-5bdf-4c5f-ada8-a6e466f038d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e030a9fb-5bdf-4c5f-ada8-a6e466f038d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b992eeb6-b587-4e59-afdb-4aef6c67684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b992eeb6-b587-4e59-afdb-4aef6c67684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd5ad5d-8446-4b4a-a41d-7090ae14159a', 'volume_name': 'volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6bfbc3-9e43-4c63-9722-cdfdf2b4354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6bfbc3-9e43-4c63-9722-cdfdf2b4354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ed522f-1f72-462b-9689-2aaa0249746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume fcd5ad5d-8446-4b4a-a41d-7090ae14159a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a', 'volume_size': 1} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42" returned: 0 in 0.401s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.629s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Creating offline snapshot 92f5a20e-c7cb-4dc2-9449-0c836d51b47c of volume 1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7289881-be7c-44c3-87a7-225f074ee3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164b64b8-e856-4f56-93c1-b775cd496b42', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53ecca3-eeeb-400c-ab22-c8a74b07e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecac32c6-1cc1-4b1c-97b6-391160e15b56]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Volume volume-164b64b8-e856-4f56-93c1-b775cd496b42 (164b64b8-e856-4f56-93c1-b775cd496b42): created successfully Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53ecca3-eeeb-400c-ab22-c8a74b07e88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Flow 'volume_create_manager' (f37789a0-767a-439d-8060-6376789e3302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:04 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-00c70a49-de2c-433e-b814-5febbbdb6e98 tempest-CreateVolumesFromImageTest-204735912 None] Created volume successfully. Sep 28 15:22:04 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 Sep 28 15:22:04 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:04 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD" returned: 1 in 0.502s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (a4ebebe3-5c57-4785-8598-f1a56ef4defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c291b2b5-732d-47ba-81c8-f67481a07f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c291b2b5-732d-47ba-81c8-f67481a07f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795124709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2649ab3b-7af7-44f2-bf48-bcdd6120c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:05Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43430e58-e30a-4b0e-b8e8-eaf2bf9c5805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43430e58-e30a-4b0e-b8e8-eaf2bf9c5805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57816338-2944-4923-9120-bba17463f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57816338-2944-4923-9120-bba17463f078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2649ab3b-7af7-44f2-bf48-bcdd6120c464', 'volume_name': 'volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef1d9a6-eac3-46be-b6b3-fb6caef4907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef1d9a6-eac3-46be-b6b3-fb6caef4907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb5e97a-877f-467c-b9f8-d8abab92f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume 2649ab3b-7af7-44f2-bf48-bcdd6120c464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464', 'volume_size': 1} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:05 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2" returned: 0 in 0.403s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c 1G Sep 28 15:22:05 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-164b64b8-e856-4f56-93c1-b775cd496b42-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-164b64b8-e856-4f56-93c1-b775cd496b42-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-quobyte-164b64b8-e856-4f56-93c1-b775cd496b42" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-164b64b8-e856-4f56-93c1-b775cd496b42" acquired by "delete_volume" :: waited 0.014s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3a4bd-c19d-4bb3-8dc6-1948880e9e67]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 Sep 28 15:22:05 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c 1G" returned: 0 in 0.422s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc238ce-774c-46e0-8e94-48854d670ca2 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc238ce-774c-46e0-8e94-48854d670ca2 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c Sep 28 15:22:05 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42" returned: 0 in 0.392s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42 Sep 28 15:22:05 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc238ce-774c-46e0-8e94-48854d670ca2 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c" returned: 0 in 0.317s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c is being set with open permissions: ugo+rw Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:05 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c Sep 28 15:22:05 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:05 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-164b64b8-e856-4f56-93c1-b775cd496b42" returned: 0 in 0.282s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-164b64b8-e856-4f56-93c1-b775cd496b42" released by "delete_volume" :: held 0.715s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:05 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Created reservations ['172ecae7-f120-4369-b5c1-ff1d981f9cd8', '2e3fe394-c351-4eaf-bc7b-c6f4a3c9ce7e', '2cf49d52-3776-4c40-aa54-dbe58ee3eba8', '179f9817-97a9-43ce-89b8-34c775d89dd7'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:06 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c" returned: 0 in 0.263s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:06 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:06 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:06 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.info Sep 28 15:22:06 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-545cd50e-fc3c-4d5f-91aa-4057d52edacc-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-545cd50e-fc3c-4d5f-91aa-4057d52edacc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-quobyte-545cd50e-fc3c-4d5f-91aa-4057d52edacc" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:06 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.360s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:06 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-545cd50e-fc3c-4d5f-91aa-4057d52edacc" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Deleted volume successfully. Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.info" returned: 0 in 0.340s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:06 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.info is being set with open permissions: ugo+rw Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f035614-d542-4133-af30-8ff3df9ec98e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:06 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.info Sep 28 15:22:06 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e4bd563a-f5fc-4a50-8890-6bc4fe8cdd45 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-164b64b8-e856-4f56-93c1-b775cd496b42-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:06 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc Sep 28 15:22:06 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:06 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.info" returned: 0 in 0.262s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.712s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670723771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7835494-16e4-4ec0-85fc-87ba55620d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:03Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Creating volume b7835494-16e4-4ec0-85fc-87ba55620d06 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:06 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:06 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 1073741824 Sep 28 15:22:06 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-572c8caa-4633-4144-85f8-99cf926e2af4 tempest-VolumeDependencyTests-336180652 None] Create snapshot completed successfully Sep 28 15:22:06 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc" returned: 0 in 0.461s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:06 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc Sep 28 15:22:06 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-545cd50e-fc3c-4d5f-91aa-4057d52edacc" returned: 0 in 0.276s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 1073741824" returned: 0 in 0.484s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-545cd50e-fc3c-4d5f-91aa-4057d52edacc" released by "delete_volume" :: held 0.821s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 Sep 28 15:22:07 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Created reservations ['15d34067-f65e-42e1-a82b-698c65270255', '0634b07e-5519-4239-ab08-b54d8f0e520f', 'a274492f-c586-4ce2-aade-070204788be2', 'f780849c-06e6-44c8-9a36-09f500e8f269'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:07 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-1f339369-7bd4-40e7-9eac-38dd13ffa01f-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-1f339369-7bd4-40e7-9eac-38dd13ffa01f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:07 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06" returned: 0 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.063s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1730781688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a067ab-43c9-4590-a6cc-653133eadacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:03Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Creating volume 13a067ab-43c9-4590-a6cc-653133eadacb {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:07 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb 1073741824 Sep 28 15:22:07 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b2ea69-aad6-42b5-8993-824c9a128950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7835494-16e4-4ec0-85fc-87ba55620d06', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caef5ac9-d899-49a4-8fc7-82a1e63772c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-quobyte-1f339369-7bd4-40e7-9eac-38dd13ffa01f" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:07 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume volume-b7835494-16e4-4ec0-85fc-87ba55620d06 (b7835494-16e4-4ec0-85fc-87ba55620d06): created successfully Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caef5ac9-d899-49a4-8fc7-82a1e63772c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (b169c160-3933-4d08-8213-c8bf5bd3bba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-1f339369-7bd4-40e7-9eac-38dd13ffa01f" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:07 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-96769a7e-f6b0-4754-a598-9acf25dd014a tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created volume successfully. Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c42c1be-b7b7-40cd-b476-64ae18bd2e65]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:07 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Deleted volume successfully. Sep 28 15:22:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb917b14-7664-4f8f-9744-fca7da5b027f tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-545cd50e-fc3c-4d5f-91aa-4057d52edacc-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:08 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f Sep 28 15:22:08 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Flow 'volume_create_manager' (79db0380-9388-4c90-9f6b-e7249c0af974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff926cd5-ddf2-49d7-9dba-ce0e771cea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff926cd5-ddf2-49d7-9dba-ce0e771cea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524268260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26648f70-fe19-433e-bdab-a9301e5ccd52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0984b0d2f4414bdd9cc459acc57f198f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92f5a20e-c7cb-4dc2-9449-0c836d51b47c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:08Z,use_quota=True,user_id='245ac280d5a94789951bd15a202d461c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4980cd8b-c73a-4eec-8bc7-3d836dc5a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4980cd8b-c73a-4eec-8bc7-3d836dc5a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3417e7e6-5436-4b0f-a775-aabb58a189f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3417e7e6-5436-4b0f-a775-aabb58a189f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26648f70-fe19-433e-bdab-a9301e5ccd52', 'volume_name': 'volume-26648f70-fe19-433e-bdab-a9301e5ccd52', 'volume_size': 1, 'snapshot_id': '92f5a20e-c7cb-4dc2-9449-0c836d51b47c'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c98c38-6660-4004-b66b-b7308b1dfc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c98c38-6660-4004-b66b-b7308b1dfc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95188537-d9fd-4c08-8c0f-5cb223f486a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Volume 26648f70-fe19-433e-bdab-a9301e5ccd52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26648f70-fe19-433e-bdab-a9301e5ccd52', 'volume_size': 1, 'snapshot_id': '92f5a20e-c7cb-4dc2-9449-0c836d51b47c'} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb 1073741824" returned: 0 in 0.641s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f" returned: 0 in 0.487s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:08 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f Sep 28 15:22:08 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb Sep 28 15:22:08 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f339369-7bd4-40e7-9eac-38dd13ffa01f" returned: 0 in 0.293s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-1f339369-7bd4-40e7-9eac-38dd13ffa01f" released by "delete_volume" :: held 0.848s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:08 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb" returned: 0 in 0.293s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.543s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1976590506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7c5e98-00ab-4a63-9bd8-4067005f8e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:04Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Creating volume 1c7c5e98-00ab-4a63-9bd8-4067005f8e1e {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:08 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e 1073741824 Sep 28 15:22:08 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f24b106-3fe3-4647-a84c-6a2ad3077c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a067ab-43c9-4590-a6cc-653133eadacb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9413181-8fa1-4c38-9f4d-b43f2e1cc502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Created reservations ['2742ae37-9ea4-4846-b0c6-17f88c264b7f', 'f1a0f543-dfb1-47dd-9606-514fd95bd3d2', '2c89eab1-2e51-4bf5-bf42-44baf011608f', 'e0afced9-5687-419b-8e8c-0826e3d04c5c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume volume-13a067ab-43c9-4590-a6cc-653133eadacb (13a067ab-43c9-4590-a6cc-653133eadacb): created successfully Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9413181-8fa1-4c38-9f4d-b43f2e1cc502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (70806192-44f2-4744-98fb-01541a7955de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7f0b2302-0bff-4e66-9d2e-d2c91c54d9fa tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created volume successfully. Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:08 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:09 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.261s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Deleted volume successfully. Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e1b9b39e-636f-4fa9-ba5c-477ad4cf1ed0 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-1f339369-7bd4-40e7-9eac-38dd13ffa01f-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:09 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e 1073741824" returned: 0 in 0.487s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:09 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e Sep 28 15:22:09 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:09 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e" returned: 0 in 0.269s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.865s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409724663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd5ad5d-8446-4b4a-a41d-7090ae14159a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:04Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Creating volume fcd5ad5d-8446-4b4a-a41d-7090ae14159a {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:09 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d7a9a6-0381-4420-a77a-9686812fd676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a 1073741824 Sep 28 15:22:09 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba5c3e7-8a3c-4941-ab43-713be117ff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:09 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e (1c7c5e98-00ab-4a63-9bd8-4067005f8e1e): created successfully Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba5c3e7-8a3c-4941-ab43-713be117ff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (7a55f54e-a25a-47b3-8103-b40590ff283c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-93735576-aaae-4639-9379-b7e30599cdb1 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created volume successfully. Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-073defd1-1b55-486c-b36d-a00bdabc0391-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-073defd1-1b55-486c-b36d-a00bdabc0391-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-quobyte-073defd1-1b55-486c-b36d-a00bdabc0391" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-073defd1-1b55-486c-b36d-a00bdabc0391" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8352000f-19bd-4212-aa9e-59bdd94ff16e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a 1073741824" returned: 0 in 0.510s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a Sep 28 15:22:10 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:10 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 Sep 28 15:22:10 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:10 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a" returned: 0 in 0.263s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.489s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba44d1ee36c44b6a248b7514bc37845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:02Z,use_quota=True,user_id='7eb20b2d2fbf4a4ebb72b7d6f90ba778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a1ec7f6-3def-49bf-948f-2c74a3d49415),volume_type_id=7a1ec7f6-3def-49bf-948f-2c74a3d49415)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Creating volume 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:10 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ed522f-1f72-462b-9689-2aaa0249746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3b5eb5-2f7c-4040-95ee-e4da66c2c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:10 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 1073741824 Sep 28 15:22:10 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:10 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a (fcd5ad5d-8446-4b4a-a41d-7090ae14159a): created successfully Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3b5eb5-2f7c-4040-95ee-e4da66c2c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (757bf88f-8912-4913-a967-1113516bfee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:10 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d00f974e-9c62-4b55-985d-7e0391196f62 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created volume successfully. Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391" returned: 0 in 0.457s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391 Sep 28 15:22:10 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:10 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-073defd1-1b55-486c-b36d-a00bdabc0391" returned: 0 in 0.302s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-073defd1-1b55-486c-b36d-a00bdabc0391" released by "delete_volume" :: held 0.803s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Created reservations ['bd7c252d-121b-4832-a68d-34d5d654a772', '909bdab8-10bd-4a05-971c-6656a162ea41', 'bcf5c223-aa94-4669-b396-43d2fc5c2f2a', '1882bc92-f542-4641-912b-192e6ae302b6'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:10 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 1073741824" returned: 0 in 0.539s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:10 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:10 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 Sep 28 15:22:10 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-6d81caad-dd07-42e7-a370-7a2ec4be98b4-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-6d81caad-dd07-42e7-a370-7a2ec4be98b4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "cinder-quobyte-6d81caad-dd07-42e7-a370-7a2ec4be98b4" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-6d81caad-dd07-42e7-a370-7a2ec4be98b4" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:11 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3645d-be83-4d49-96cb-8d6637e39967]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.312s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Deleted volume successfully. Sep 28 15:22:11 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222" returned: 0 in 0.300s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.215s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795124709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2649ab3b-7af7-44f2-bf48-bcdd6120c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef59ab113d004a92b779dafb8c33f2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:05Z,use_quota=True,user_id='84a55174c48643cd8d51d086959e46c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Creating volume 2649ab3b-7af7-44f2-bf48-bcdd6120c464 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:11 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 1073741824 Sep 28 15:22:11 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7c7c3030-2397-4f3b-be5f-ae385018b41c tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-073defd1-1b55-486c-b36d-a00bdabc0391-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Attempting download of 7db21517-bbfa-4926-94d2-d016d323c0f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7db21517-bbfa-4926-94d2-d016d323c0f7', 'metadata': {}}])) to volume 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:22:11 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 Sep 28 15:22:11 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[99463dc2-728a-4ca5-b6a7-08393748bc2b]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7db21517-bbfa-4926-94d2-d016d323c0f7_k_ek_v36 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7db21517-bbfa-4926-94d2-d016d323c0f7_k_ek_v36 Sep 28 15:22:11 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4" returned: 0 in 0.500s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4 Sep 28 15:22:11 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 1073741824" returned: 0 in 0.526s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7db21517-bbfa-4926-94d2-d016d323c0f7_k_ek_v36" returned: 0 in 0.423s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db21517-bbfa-4926-94d2-d016d323c0f7_k_ek_v36 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:11 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 Sep 28 15:22:11 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db21517-bbfa-4926-94d2-d016d323c0f7_k_ek_v36 Sep 28 15:22:11 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:11 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6d81caad-dd07-42e7-a370-7a2ec4be98b4" returned: 0 in 0.275s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:11 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-quobyte-6d81caad-dd07-42e7-a370-7a2ec4be98b4" released by "delete_volume" :: held 0.826s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Created reservations ['6bbd005a-c69d-4daf-a7a9-028d64c50dea', 'c55d0989-2a6a-4889-b9ef-f4a71ed6d045', '752a824f-d24e-4a4d-97d2-d5b931b1febc', '51ddc56e-e286-488d-bc52-9e5145309b92'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:12 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464" returned: 0 in 0.272s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.770s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-quobyte-92f5a20e-c7cb-4dc2-9449-0c836d51b47c-26648f70-fe19-433e-bdab-a9301e5ccd52" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb5e97a-877f-467c-b9f8-d8abab92f49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bec11d4-c15f-461b-9828-4bcd3af43f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-92f5a20e-c7cb-4dc2-9449-0c836d51b47c-26648f70-fe19-433e-bdab-a9301e5ccd52" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Creating volume 26648f70-fe19-433e-bdab-a9301e5ccd52 from snapshot 92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-quobyte-26648f70-fe19-433e-bdab-a9301e5ccd52" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:12 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db21517-bbfa-4926-94d2-d016d323c0f7_k_ek_v36" returned: 1 in 0.378s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db21517-bbfa-4926-94d2-d016d323c0f7_k_ek_v36' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7185709e-c5dc-451e-8425-b5107a34fc98]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-26648f70-fe19-433e-bdab-a9301e5ccd52" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] snapshot: 92f5a20e-c7cb-4dc2-9449-0c836d51b47c, volume: 26648f70-fe19-433e-bdab-a9301e5ccd52, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:22:12 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Volume volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 (2649ab3b-7af7-44f2-bf48-bcdd6120c464): created successfully Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bec11d4-c15f-461b-9828-4bcd3af43f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Flow 'volume_create_manager' (a4ebebe3-5c57-4785-8598-f1a56ef4defc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:12 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:12 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d8054d4f-f96d-4b36-ae73-32d80a22a434 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created volume successfully. Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca97bd14-2a37-4f00-a7f8-dd8a7f0cccd7]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:12 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD Sep 28 15:22:12 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:12 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c Sep 28 15:22:12 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:12 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.397s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Deleted volume successfully. Sep 28 15:22:12 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-39ebcc41-5240-424d-beb8-e4acfa4f0944 tempest-CreateVolumesFromImageTest-204735912 None] Lock "cinder-6d81caad-dd07-42e7-a370-7a2ec4be98b4-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-2649ab3b-7af7-44f2-bf48-bcdd6120c464-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-2649ab3b-7af7-44f2-bf48-bcdd6120c464-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-quobyte-2649ab3b-7af7-44f2-bf48-bcdd6120c464" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-2649ab3b-7af7-44f2-bf48-bcdd6120c464" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7c36f1-cc04-4e1b-8d71-feddec36fc74]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:12 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:12 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD Sep 28 15:22:12 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c" returned: 0 in 0.559s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bc238ce-774c-46e0-8e94-48854d670ca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf530de5-6e11-4970-910c-3f923fb878be]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 Sep 28 15:22:13 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:13 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 Sep 28 15:22:13 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:13 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD" returned: 1 in 0.503s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] 7db21517-bbfa-4926-94d2-d016d323c0f7 was raw, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 Sep 28 15:22:13 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:13 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2" returned: 0 in 0.466s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464" returned: 0 in 0.531s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 Sep 28 15:22:13 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:13 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464 Sep 28 15:22:13 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:13 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-2649ab3b-7af7-44f2-bf48-bcdd6120c464" returned: 0 in 0.348s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-2649ab3b-7af7-44f2-bf48-bcdd6120c464" released by "delete_volume" :: held 0.935s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:13 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222" returned: 0 in 0.685s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7db21517-bbfa-4926-94d2-d016d323c0f7_utynfp7zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:22:13 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:13 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created reservations ['a8648886-357d-40f9-b447-2e76a7a87021', 'e7f13db3-3b3f-4eb5-bfb2-11c605b7e1c9', 'c8c959ff-d56d-41d0-87fb-e24e80dc911c', '55515416-d280-4fe7-8059-976c2819bab5'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:13 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 1G Sep 28 15:22:13 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:14 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:14 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:14 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.544s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Deleted volume successfully. Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-03ca356b-4e0c-4d29-95d5-1d419404b075 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-2649ab3b-7af7-44f2-bf48-bcdd6120c464-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:14 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 1G" returned: 0 in 0.772s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Downloaded image 7db21517-bbfa-4926-94d2-d016d323c0f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7db21517-bbfa-4926-94d2-d016d323c0f7', 'metadata': {}}])) to volume 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Temporary image 7db21517-bbfa-4926-94d2-d016d323c0f7 for user 7eb20b2d2fbf4a4ebb72b7d6f90ba778 is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Marking volume 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Copying metadata from image 7db21517-bbfa-4926-94d2-d016d323c0f7 to 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Creating volume glance metadata for volume 1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 backed by image 7db21517-bbfa-4926-94d2-d016d323c0f7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7db21517-bbfa-4926-94d2-d016d323c0f7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b53338470df3a5ac88e45beb893c784a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132b6390-6a45-40aa-8347-fff55b8755da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222', 'volume_size': 1, 'image_id': '7db21517-bbfa-4926-94d2-d016d323c0f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7db21517-bbfa-4926-94d2-d016d323c0f7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b53338470df3a5ac88e45beb893c784a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ba44d1ee36c44b6a248b7514bc37845', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c56aa104d16ddf04b7fb8e912ea0b68d186e86e72ea51ff93375c1835d23e9c297c81537863cd6ebd6857150f2f9d125dc229b6320e346749460c01ccf749f2', 'id': '7db21517-bbfa-4926-94d2-d016d323c0f7', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7db21517-bbfa-4926-94d2-d016d323c0f7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0b471f-4a14-4991-a7fa-01501f4b292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Volume volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 (1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222): created successfully Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0b471f-4a14-4991-a7fa-01501f4b292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Flow 'volume_create_manager' (f4dedb2b-9e9b-4920-95e7-8ba1b776fea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6c3f1559-cd85-44a6-ab70-9850b3350cc3 tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Created volume successfully. Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-fcd5ad5d-8446-4b4a-a41d-7090ae14159a-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-fcd5ad5d-8446-4b4a-a41d-7090ae14159a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Acquiring lock "cinder-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "cinder-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-quobyte-fcd5ad5d-8446-4b4a-a41d-7090ae14159a" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-fcd5ad5d-8446-4b4a-a41d-7090ae14159a" acquired by "delete_volume" :: waited 0.059s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Acquiring lock "cinder-quobyte-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "cinder-quobyte-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222" acquired by "delete_volume" :: waited 0.037s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[838533c9-b0ff-4b92-b656-7738568cbbe1]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5170805-c67a-4764-8e2e-3ac1afbd9715]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:15 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a Sep 28 15:22:15 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:15 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 Sep 28 15:22:15 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222" returned: 0 in 0.703s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:16 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a" returned: 0 in 0.779s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:16 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222 Sep 28 15:22:16 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a Sep 28 15:22:16 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:16 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222" returned: 0 in 0.526s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "cinder-quobyte-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222" released by "delete_volume" :: held 1.336s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:16 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Created reservations ['320dbca8-614c-4cac-82ec-88d4fa8f6b99', '6a771993-95e6-4a17-9fe8-85f840e826c7', 'c87aca3d-0bb1-480c-afc7-285a3f7b5bc8', '52de7351-f3a7-4c85-b89a-18ff87b710d9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fcd5ad5d-8446-4b4a-a41d-7090ae14159a" returned: 0 in 0.699s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-fcd5ad5d-8446-4b4a-a41d-7090ae14159a" released by "delete_volume" :: held 1.635s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created reservations ['b620e461-757e-4f4c-acca-e785a4b5d13d', '90f1e1df-b832-40dc-b733-4122ffda3ad9', '77acbab6-9be7-4c6f-b872-17e907ff72eb', '6bcb9522-4f9a-422d-b79d-be0562a73f55'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:17 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:17 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:17 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:17 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:17 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.713s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:17 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Deleted volume successfully. Sep 28 15:22:17 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ad296e78-560c-4fca-b353-72b904e967cc tempest-VolumeAndVolumeTypeFromImageTest-874068541 None] Lock "cinder-1c14f3a3-3b8d-4b9e-a3c5-6964f01d0222-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-quobyte-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:18 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.667s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:18 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Deleted volume successfully. Sep 28 15:22:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cf3dd794-35b7-481f-a7fa-8327820fe5ee tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-fcd5ad5d-8446-4b4a-a41d-7090ae14159a-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95a61c-15a2-4b8a-8c72-0f7ce4b25fef]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:18 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e Sep 28 15:22:18 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:18 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e" returned: 0 in 0.798s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:19 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e Sep 28 15:22:19 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:19 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e" returned: 0 in 0.439s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e" released by "delete_volume" :: held 1.418s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created reservations ['a0740fea-1a9f-4735-897d-3ee57de38c80', '529e7ad8-017c-4ef7-bdb8-7ec7e358418e', '7f86d23a-cf72-4e8f-9e70-41f8b8950ea0', 'f3659774-7f51-4d6b-931c-37a07e0d8411'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:19 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:19 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:20 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.408s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:20 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Deleted volume successfully. Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fb525830-0b28-47de-9510-e487afbe6916 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-1c7c5e98-00ab-4a63-9bd8-4067005f8e1e-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-13a067ab-43c9-4590-a6cc-653133eadacb-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-13a067ab-43c9-4590-a6cc-653133eadacb-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-quobyte-13a067ab-43c9-4590-a6cc-653133eadacb" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-13a067ab-43c9-4590-a6cc-653133eadacb" acquired by "delete_volume" :: waited 0.037s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0426fd3-a5eb-4255-9b64-fb7a7578aaf3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:20 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb Sep 28 15:22:20 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:21 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb" returned: 0 in 0.755s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:21 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb Sep 28 15:22:21 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:22 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-13a067ab-43c9-4590-a6cc-653133eadacb" returned: 0 in 0.707s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-13a067ab-43c9-4590-a6cc-653133eadacb" released by "delete_volume" :: held 1.580s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created reservations ['8084fc48-041e-443c-8047-3efd00136d9d', 'b1f899af-3b82-4d52-a864-33980eef5aca', '2d47fcd8-fbe2-4f33-b5b9-90f360108196', '43df3bac-31bc-4624-b5a1-3800ddeb61e8'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:22 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:22 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:22 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52" returned: 0 in 9.250s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2, size 1024.00 MB, duration 9.25 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:22:22 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Converted 1024.00 MB image at 110.66 MB/s Sep 28 15:22:22 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 is being set with open permissions: ugo+rw Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:22 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 Sep 28 15:22:22 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-b7835494-16e4-4ec0-85fc-87ba55620d06-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-b7835494-16e4-4ec0-85fc-87ba55620d06-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-quobyte-b7835494-16e4-4ec0-85fc-87ba55620d06" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-b7835494-16e4-4ec0-85fc-87ba55620d06" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:23 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c47e2c-0132-4a5d-8169-005cb1691259]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:23 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52" returned: 0 in 0.433s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.512s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Deleted volume successfully. Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-26648f70-fe19-433e-bdab-a9301e5ccd52" released by "_copy_volume_from_snapshot" :: held 10.922s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-276e1936-79c2-43e6-8c7b-7ffc97ec7501 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-13a067ab-43c9-4590-a6cc-653133eadacb-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-92f5a20e-c7cb-4dc2-9449-0c836d51b47c-26648f70-fe19-433e-bdab-a9301e5ccd52" released by "_create_volume_from_snapshot" :: held 11.029s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.072s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95188537-d9fd-4c08-8c0f-5cb223f486a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26648f70-fe19-433e-bdab-a9301e5ccd52', 'volume_size': 1, 'snapshot_id': '92f5a20e-c7cb-4dc2-9449-0c836d51b47c'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9263038c-e366-456f-adbe-27ec660b065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:23 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Volume volume-26648f70-fe19-433e-bdab-a9301e5ccd52 (26648f70-fe19-433e-bdab-a9301e5ccd52): created successfully Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9263038c-e366-456f-adbe-27ec660b065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Flow 'volume_create_manager' (79db0380-9388-4c90-9f6b-e7249c0af974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:23 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 Sep 28 15:22:23 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-7e42d9ef-2d0d-4822-89b8-3679c5b5aa5a tempest-VolumeDependencyTests-336180652 None] Created volume successfully. Sep 28 15:22:23 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06" returned: 0 in 0.540s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:23 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06 Sep 28 15:22:23 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b7835494-16e4-4ec0-85fc-87ba55620d06" returned: 0 in 0.288s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-b7835494-16e4-4ec0-85fc-87ba55620d06" released by "delete_volume" :: held 0.915s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:23 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created reservations ['e5b10c07-f271-4e25-9ba0-1e23f786d24c', '8dc5c47e-8723-4b73-89d8-a4c531a22441', 'd92b63c6-a399-41af-a0b8-41a4ee48f79e', 'af462d4b-9a0a-4264-8b9c-dd43ee785158'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:24 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:24 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:24 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.306s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Deleted volume successfully. Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-85456900-1b78-402a-870c-e27d43d16e42 tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-b7835494-16e4-4ec0-85fc-87ba55620d06-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-92f5a20e-c7cb-4dc2-9449-0c836d51b47c-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Lock "cinder-92f5a20e-c7cb-4dc2-9449-0c836d51b47c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-quobyte-1bc238ce-774c-46e0-8e94-48854d670ca2" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-1bc238ce-774c-46e0-8e94-48854d670ca2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-quobyte-92f5a20e-c7cb-4dc2-9449-0c836d51b47c" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-92f5a20e-c7cb-4dc2-9449-0c836d51b47c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Deleting offline snapshot 92f5a20e-c7cb-4dc2-9449-0c836d51b47c of volume 1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] snapshot_file for this snap is: volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb5b300-24dd-4128-954a-4a8d531df216]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:24 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c Sep 28 15:22:24 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bc238ce-774c-46e0-8e94-48854d670ca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[57263a75-5ae7-4087-91c5-a4b2c0da0299]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-1f53ce20-1afa-45b7-bf73-0b2506516537-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-1f53ce20-1afa-45b7-bf73-0b2506516537-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:25 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 Sep 28 15:22:25 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "cinder-quobyte-1f53ce20-1afa-45b7-bf73-0b2506516537" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-1f53ce20-1afa-45b7-bf73-0b2506516537" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5190ac-70f4-452a-a3b7-492eadc4c804]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 Sep 28 15:22:25 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2" returned: 0 in 0.712s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:25 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537" returned: 0 in 0.531s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:25 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537 Sep 28 15:22:25 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (e33e8143-de77-44eb-8bc4-ad0896db30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e554a7-c021-4cad-8a39-4447365e2404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e554a7-c021-4cad-8a39-4447365e2404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1923846357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75daede-4161-45ba-9f4b-01448827ca54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:26Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58458cb0-5700-474d-bba0-d13df7e68c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58458cb0-5700-474d-bba0-d13df7e68c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9c4c41-412b-4fd2-86a6-74550c3526f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9c4c41-412b-4fd2-86a6-74550c3526f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75daede-4161-45ba-9f4b-01448827ca54', 'volume_name': 'volume-f75daede-4161-45ba-9f4b-01448827ca54', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab16b76a-8926-48ba-bb1e-ee9c0ed07a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab16b76a-8926-48ba-bb1e-ee9c0ed07a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689e1b27-25e4-42c2-8b5c-7ed024549364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:26 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume f75daede-4161-45ba-9f4b-01448827ca54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75daede-4161-45ba-9f4b-01448827ca54', 'volume_size': 1} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1923846357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75daede-4161-45ba-9f4b-01448827ca54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:26Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Creating volume f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:26 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:26 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 1073741824 Sep 28 15:22:26 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:26 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f53ce20-1afa-45b7-bf73-0b2506516537" returned: 0 in 0.305s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-quobyte-1f53ce20-1afa-45b7-bf73-0b2506516537" released by "delete_volume" :: held 0.889s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c" returned: 0 in 0.417s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Created reservations ['fdb060b7-119d-4dbd-9d96-25fb6422812d', '191bfaa4-e1d4-4602-ace5-333d0be36f54', '53625c5a-9ddd-4bbb-8ead-0abba94b4acd', '7c04f016-c94e-4b64-8ce9-da4dcb10a4dd'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:26 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c Sep 28 15:22:26 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:26 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:26 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:26 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2.92f5a20e-c7cb-4dc2-9449-0c836d51b47c" returned: 0 in 0.342s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-92f5a20e-c7cb-4dc2-9449-0c836d51b47c" released by "_delete_snapshot" :: held 2.098s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-1bc238ce-774c-46e0-8e94-48854d670ca2" released by "delete_snapshot" :: held 2.132s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.378s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:26 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Deleted volume successfully. Sep 28 15:22:26 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 1073741824" returned: 0 in 0.668s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3476344-06a5-4146-9310-6f759599b12c tempest-CreateVolumesFromSourceVolumeTest-1781049736 None] Lock "cinder-1f53ce20-1afa-45b7-bf73-0b2506516537-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Created reservations ['16cba631-1a86-4494-ae91-01b9f1d15aac', '5990a842-41e3-4bf5-ba67-23717c5bfed4', 'e4613828-be7e-44ef-bf5d-afa2c3749716', '2e2bc439-1f25-447f-b4a6-57477f58e183'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:26 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 Sep 28 15:22:26 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:26 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Delete snapshot completed successfully. Sep 28 15:22:26 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-67713b2e-f98f-43e0-8026-3b5cf7bf655f tempest-VolumeDependencyTests-336180652 None] Lock "cinder-92f5a20e-c7cb-4dc2-9449-0c836d51b47c-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:27 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54" returned: 0 in 0.268s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689e1b27-25e4-42c2-8b5c-7ed024549364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75daede-4161-45ba-9f4b-01448827ca54', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d15cc9d-f88c-405e-a24a-0d2cf592d6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume volume-f75daede-4161-45ba-9f4b-01448827ca54 (f75daede-4161-45ba-9f4b-01448827ca54): created successfully Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d15cc9d-f88c-405e-a24a-0d2cf592d6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (e33e8143-de77-44eb-8bc4-ad0896db30c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:27 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4240e607-417b-4af0-9f48-409fed6c7493 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created volume successfully. Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-1bc238ce-774c-46e0-8e94-48854d670ca2-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-1bc238ce-774c-46e0-8e94-48854d670ca2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-quobyte-1bc238ce-774c-46e0-8e94-48854d670ca2" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-1bc238ce-774c-46e0-8e94-48854d670ca2" acquired by "delete_volume" :: waited 0.014s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c3ce39-a69f-4238-953a-ce5a87d9e089]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:27 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (54dd6bc8-f813-49fa-b8ab-5a19c68bb036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41de3e2b-bbcf-4272-b414-f0facf9b9851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41de3e2b-bbcf-4272-b414-f0facf9b9851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1495709983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689b25d0-7256-4880-8391-efc516dd2849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbad974-42f2-4899-9873-3d972242408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbad974-42f2-4899-9873-3d972242408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 Sep 28 15:22:28 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b57072-bdb6-4f55-a5ee-ce04e238a009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b57072-bdb6-4f55-a5ee-ce04e238a009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689b25d0-7256-4880-8391-efc516dd2849', 'volume_name': 'volume-689b25d0-7256-4880-8391-efc516dd2849', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d0eae6-dcb3-47a9-83cf-2ef27da84be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d0eae6-dcb3-47a9-83cf-2ef27da84be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377b9b66-1920-44ea-bf76-8bf06e97f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Volume 689b25d0-7256-4880-8391-efc516dd2849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689b25d0-7256-4880-8391-efc516dd2849', 'volume_size': 1} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1495709983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689b25d0-7256-4880-8391-efc516dd2849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Creating volume 689b25d0-7256-4880-8391-efc516dd2849 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:28 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 1073741824 Sep 28 15:22:28 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2" returned: 0 in 0.518s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2 Sep 28 15:22:28 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1bc238ce-774c-46e0-8e94-48854d670ca2" returned: 0 in 0.301s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:28 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 1073741824" returned: 0 in 0.616s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-1bc238ce-774c-46e0-8e94-48854d670ca2" released by "delete_volume" :: held 0.906s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 Sep 28 15:22:28 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Created reservations ['63616090-caa3-4584-ae10-8b6014637ab1', '71296374-2c68-4bf3-9d98-57ce2a13cb29', '922383d2-8e2f-45a3-aa81-d6332c9d440d', 'ccf11a59-0a25-472c-9aa4-c8af48e32853'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:28 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:29 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849" returned: 0 in 0.277s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.663s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377b9b66-1920-44ea-bf76-8bf06e97f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689b25d0-7256-4880-8391-efc516dd2849', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ec034-6d05-48c8-9d74-043d97b5027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Creating offline snapshot 10ad581f-5f9d-4815-a789-0525040689e9 of volume f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:29 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Volume volume-689b25d0-7256-4880-8391-efc516dd2849 (689b25d0-7256-4880-8391-efc516dd2849): created successfully Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ec034-6d05-48c8-9d74-043d97b5027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (54dd6bc8-f813-49fa-b8ab-5a19c68bb036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[051017e9-bd73-4270-a80a-b9d6f4b57156]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a9546cf6-9277-4c38-b35d-bc4417be2fd0 tempest-ProjectReaderTests-1205366221 None] Created volume successfully. Sep 28 15:22:29 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.258s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Deleted volume successfully. Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-4539ab74-246e-4b36-a09d-5bd7a571f265 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-1bc238ce-774c-46e0-8e94-48854d670ca2-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:29 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 Sep 28 15:22:29 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:29 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54" returned: 0 in 0.392s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:29 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 1G Sep 28 15:22:29 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:29 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 1G" returned: 0 in 0.445s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75daede-4161-45ba-9f4b-01448827ca54 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75daede-4161-45ba-9f4b-01448827ca54 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 Sep 28 15:22:30 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-26648f70-fe19-433e-bdab-a9301e5ccd52-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-26648f70-fe19-433e-bdab-a9301e5ccd52-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Acquiring lock "cinder-quobyte-26648f70-fe19-433e-bdab-a9301e5ccd52" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-26648f70-fe19-433e-bdab-a9301e5ccd52" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[847ee540-43bf-489a-83b6-5eea86bad5bf]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 Sep 28 15:22:30 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:30 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-689b25d0-7256-4880-8391-efc516dd2849-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75daede-4161-45ba-9f4b-01448827ca54 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9" returned: 0 in 0.446s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:30 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 is being set with open permissions: ugo+rw Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-689b25d0-7256-4880-8391-efc516dd2849-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:30 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 Sep 28 15:22:30 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-quobyte-689b25d0-7256-4880-8391-efc516dd2849" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-689b25d0-7256-4880-8391-efc516dd2849" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a1cb6-9031-4e9d-a3e2-2c65ec03f9c5]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52" returned: 0 in 0.549s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 Sep 28 15:22:30 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:30 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9" returned: 0 in 0.348s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:30 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52 Sep 28 15:22:30 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.info Sep 28 15:22:30 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:31 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-26648f70-fe19-433e-bdab-a9301e5ccd52" returned: 0 in 0.287s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-quobyte-26648f70-fe19-433e-bdab-a9301e5ccd52" released by "delete_volume" :: held 0.889s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:31 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849 Sep 28 15:22:31 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:31 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.info" returned: 0 in 0.301s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.info is being set with open permissions: ugo+rw Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Created reservations ['4aa4aaee-67d1-4697-83ca-0939e289e94b', 'dfd0d0ef-d08a-4afc-a661-f0bb1cde7608', '3383c496-606b-4d2f-a391-4c53126371d8', '22ee44d6-7c0a-485b-b4f1-c28b0a010ad7'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:31 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.info Sep 28 15:22:31 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:31 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:31 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:31 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-689b25d0-7256-4880-8391-efc516dd2849" returned: 0 in 0.373s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-689b25d0-7256-4880-8391-efc516dd2849" released by "delete_volume" :: held 0.894s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:31 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.info" returned: 0 in 0.426s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.496s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-66ec20d8-e1bc-40ce-a0c5-ba39451c2d1a tempest-CreateVolumesFromSnapshotTest-2072257415 None] Create snapshot completed successfully Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Created reservations ['22de9c23-741c-46fe-9982-a61e68ad7f29', '558b4a5e-475a-4f1f-a46c-9bf65d9e0369', '851a573c-ee88-41cb-b250-7dda0dde9ab5', '5da9fb5f-ef36-4997-8637-7b4703528e93'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:31 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.390s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Deleted volume successfully. Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3c47957-94cd-4dd2-b670-ad54877da600 tempest-VolumeDependencyTests-336180652 None] Lock "cinder-26648f70-fe19-433e-bdab-a9301e5ccd52-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:31 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:31 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:32 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.315s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:32 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:32 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Deleted volume successfully. Sep 28 15:22:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-002cfaa2-98fe-4a6e-90fb-248883948f81 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-689b25d0-7256-4880-8391-efc516dd2849-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (8ba33299-959f-4217-a678-a90d3215c6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d2765a-7589-4d76-966d-2c15ad2464cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d2765a-7589-4d76-966d-2c15ad2464cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228953514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ab96f2-0f91-4f57-8da1-a8ac48a645d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:34Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6e8c7d-8b15-494d-8ac7-d6632442b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6e8c7d-8b15-494d-8ac7-d6632442b25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e29c97e-c2fd-4049-bdc9-a5d376218cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e29c97e-c2fd-4049-bdc9-a5d376218cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ab96f2-0f91-4f57-8da1-a8ac48a645d7', 'volume_name': 'volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95efbc97-9e08-4a3d-9632-5766b35e3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95efbc97-9e08-4a3d-9632-5766b35e3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cbadd-7d18-493c-bf18-cf1224786e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume 65ab96f2-0f91-4f57-8da1-a8ac48a645d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7', 'volume_size': 1} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228953514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ab96f2-0f91-4f57-8da1-a8ac48a645d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:34Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Creating volume 65ab96f2-0f91-4f57-8da1-a8ac48a645d7 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:33 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:33 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 1073741824 Sep 28 15:22:33 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:33 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:33 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:33 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (331f1c37-7b36-48c2-97c5-fe583fe25017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd4526c-374d-493d-b8b1-9d22a3a44a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd4526c-374d-493d-b8b1-9d22a3a44a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996199157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:34Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3ca2c3-87b7-4dc5-b8b7-93b32ca5eb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3ca2c3-87b7-4dc5-b8b7-93b32ca5eb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b3498d-97d8-43e8-a96e-fe2fa18759fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b3498d-97d8-43e8-a96e-fe2fa18759fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50', 'volume_name': 'volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195738e4-5f0e-472d-94d6-bf8263f58bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195738e4-5f0e-472d-94d6-bf8263f58bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e0e6b0-ab64-4506-b3a3-a18a7cc361f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Volume b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50', 'volume_size': 1} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:34 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.485s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (7acb378c-3e81-4f83-87c1-b2d25b2b8d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ed138b-3456-4d2f-91a7-df989dc98ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 1073741824" returned: 0 in 0.890s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ed138b-3456-4d2f-91a7-df989dc98ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126518940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2170b4-d2d3-4393-b0fc-01232e962b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:34Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1e2fda-9e05-4e51-a032-7ccf151434a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1e2fda-9e05-4e51-a032-7ccf151434a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc28b7bd-e8c1-4255-993c-2a7615c46c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc28b7bd-e8c1-4255-993c-2a7615c46c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2170b4-d2d3-4393-b0fc-01232e962b9e', 'volume_name': 'volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da85b90-f0a6-4504-9f7e-8736bf6f3188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da85b90-f0a6-4504-9f7e-8736bf6f3188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9904e204-0531-4b79-9403-ff864d6fe999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume 6a2170b4-d2d3-4393-b0fc-01232e962b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e', 'volume_size': 1} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:34 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 Sep 28 15:22:34 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (4ac9a362-6a09-4b67-ad6c-355f0a1dcc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08577987-9b1e-4c0b-8188-d2bfa67f75fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08577987-9b1e-4c0b-8188-d2bfa67f75fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229293580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abae38a-6224-4515-b7e9-a3a8dd183f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:35Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08707ac0-a255-4f27-9711-5271f034bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08707ac0-a255-4f27-9711-5271f034bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f4e4d-7874-4ba1-83c5-4e30246711bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f4e4d-7874-4ba1-83c5-4e30246711bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abae38a-6224-4515-b7e9-a3a8dd183f05', 'volume_name': 'volume-7abae38a-6224-4515-b7e9-a3a8dd183f05', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dc1333-1716-4b5a-bcea-1f5c1638abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dc1333-1716-4b5a-bcea-1f5c1638abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738f4384-c335-49f1-bf65-e5be6aa9df12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume 7abae38a-6224-4515-b7e9-a3a8dd183f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abae38a-6224-4515-b7e9-a3a8dd183f05', 'volume_size': 1} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (7887a548-d130-43c2-aec7-1426ea96ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab392fc-b4b0-4081-95cb-567d87b4921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab392fc-b4b0-4081-95cb-567d87b4921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151506004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9660f428-3b20-4a0c-9034-537cd5321847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:35Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c74792-6eaa-4f54-9fc7-c092e2b86729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c74792-6eaa-4f54-9fc7-c092e2b86729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b20c0a0-fb15-4544-b59e-82a6796ebc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b20c0a0-fb15-4544-b59e-82a6796ebc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9660f428-3b20-4a0c-9034-537cd5321847', 'volume_name': 'volume-9660f428-3b20-4a0c-9034-537cd5321847', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6d1745-9a38-42e9-b962-6257c842dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6d1745-9a38-42e9-b962-6257c842dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db959169-c5a7-4207-9aab-187949ba5155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume 9660f428-3b20-4a0c-9034-537cd5321847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9660f428-3b20-4a0c-9034-537cd5321847', 'volume_size': 1} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7" returned: 0 in 0.673s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996199157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:34Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Creating volume b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:35 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:35 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 1073741824 Sep 28 15:22:35 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cbadd-7d18-493c-bf18-cf1224786e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30afea82-3acb-4dc5-b110-8eb682ac22b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 (65ab96f2-0f91-4f57-8da1-a8ac48a645d7): created successfully Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30afea82-3acb-4dc5-b110-8eb682ac22b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (8ba33299-959f-4217-a678-a90d3215c6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-cba15ff1-3d3c-4533-8750-5a3577a6e2c9 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created volume successfully. Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (b7c159b5-8add-4da1-bd6f-4cf08f837d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38570379-a4b4-4f6b-aac4-4dbb7516be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38570379-a4b4-4f6b-aac4-4dbb7516be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347383112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1dc102c-46de-4b9a-8b6b-d60fad2ea872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:36Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fef42f-ffc3-41c7-a584-de0a373530c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fef42f-ffc3-41c7-a584-de0a373530c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61573fb-8ef9-440e-9126-8024a09b884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61573fb-8ef9-440e-9126-8024a09b884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1dc102c-46de-4b9a-8b6b-d60fad2ea872', 'volume_name': 'volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b8c536-54ca-4178-b939-129ab5b1943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b8c536-54ca-4178-b939-129ab5b1943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5716621c-e7ba-4e9a-9c16-a0f23a37bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume a1dc102c-46de-4b9a-8b6b-d60fad2ea872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872', 'volume_size': 1} Sep 28 15:22:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:36 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 1073741824" returned: 0 in 0.660s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 Sep 28 15:22:36 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50" returned: 0 in 0.301s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126518940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2170b4-d2d3-4393-b0fc-01232e962b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:34Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Creating volume 6a2170b4-d2d3-4393-b0fc-01232e962b9e {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:36 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e 1073741824 Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e0e6b0-ab64-4506-b3a3-a18a7cc361f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:36 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac50a37-4a2d-41f4-b9bc-b4f5dd82a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:36 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Volume volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 (b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50): created successfully Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac50a37-4a2d-41f4-b9bc-b4f5dd82a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (331f1c37-7b36-48c2-97c5-fe583fe25017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ad324ee6-3615-42cf-abdb-ba144677696a tempest-ProjectReaderTests-1205366221 None] Created volume successfully. Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Flow 'volume_create_manager' (bba2f6eb-b2f7-411a-a664-1512d3e73808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2c2920-cb9f-4b6b-924d-46e7fd65da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2c2920-cb9f-4b6b-924d-46e7fd65da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f1584e-94c7-4ed6-85f1-f0e7cd72634e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c1d4d69d2a4c5e80fe40d78059c9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:37Z,use_quota=True,user_id='6cbb73a8edab4f18acbe50aa8fe4090e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d98c958-b685-4d56-bfe2-154cbe6a8372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d98c958-b685-4d56-bfe2-154cbe6a8372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da2a3e7-9f68-4783-829f-3cf1fd073b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da2a3e7-9f68-4783-829f-3cf1fd073b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f1584e-94c7-4ed6-85f1-f0e7cd72634e', 'volume_name': 'volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5749fe-5e1f-4392-aa53-b1d57ccbdd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5749fe-5e1f-4392-aa53-b1d57ccbdd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6431b808-fa2a-4a4c-8361-b2359ff8d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:36 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Volume f7f1584e-94c7-4ed6-85f1-f0e7cd72634e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e', 'volume_size': 1} Sep 28 15:22:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Lock "cinder-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-quobyte-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[be50e07e-318c-456e-b527-f0ba937a6ee8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e 1073741824" returned: 0 in 0.676s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 Sep 28 15:22:37 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e Sep 28 15:22:37 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (afeb1b5a-be69-48e3-bcd1-b50f19997a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb158b2-fa7a-4204-9e98-e64146eecaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb158b2-fa7a-4204-9e98-e64146eecaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-687744582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb397157-e6fe-4e34-a4fa-80446885fc8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:37Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c3a981-5be4-4f16-b194-dfd676dc9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c3a981-5be4-4f16-b194-dfd676dc9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a3b909-2bda-49ae-af2d-b41e8bc4f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a3b909-2bda-49ae-af2d-b41e8bc4f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb397157-e6fe-4e34-a4fa-80446885fc8c', 'volume_name': 'volume-cb397157-e6fe-4e34-a4fa-80446885fc8c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfe2561-4937-4622-bd3f-d184084c2d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfe2561-4937-4622-bd3f-d184084c2d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d593b514-0ae5-4b09-8abb-554b86b02c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Volume cb397157-e6fe-4e34-a4fa-80446885fc8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb397157-e6fe-4e34-a4fa-80446885fc8c', 'volume_size': 1} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50" returned: 0 in 0.374s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50 Sep 28 15:22:37 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e" returned: 0 in 0.281s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229293580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abae38a-6224-4515-b7e9-a3a8dd183f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:35Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Creating volume 7abae38a-6224-4515-b7e9-a3a8dd183f05 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:37 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9904e204-0531-4b79-9403-ff864d6fe999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 1073741824 Sep 28 15:22:37 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c151804d-16ed-40f7-aa11-1091407c07d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:37 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e (6a2170b4-d2d3-4393-b0fc-01232e962b9e): created successfully Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c151804d-16ed-40f7-aa11-1091407c07d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (7acb378c-3e81-4f83-87c1-b2d25b2b8d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:37 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-529dede0-794a-44c7-820f-e4c332f6735d tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created volume successfully. Sep 28 15:22:37 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50" returned: 0 in 0.247s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50" released by "delete_volume" :: held 0.681s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Created reservations ['f3d60c3e-859a-4231-9f5a-290aee65c26f', '5a4a31c8-c2b4-444c-a29d-c8752491ffc5', '3528e63d-92ae-4317-a549-bf0b878dda38', 'a77ef37a-0c90-4856-adec-bb8557b3735e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:37 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 1073741824" returned: 0 in 0.507s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 Sep 28 15:22:38 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.271s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:38 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Deleted volume successfully. Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-578bbc2e-13a9-4f7f-8699-0b7455081d0e tempest-ProjectReaderTests-1205366221 None] Lock "cinder-b98bcf2d-0c9d-4b6d-bcd5-aa8c9b60dd50-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:38 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05" returned: 0 in 0.279s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.910s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151506004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9660f428-3b20-4a0c-9034-537cd5321847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:35Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Creating volume 9660f428-3b20-4a0c-9034-537cd5321847 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:38 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738f4384-c335-49f1-bf65-e5be6aa9df12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abae38a-6224-4515-b7e9-a3a8dd183f05', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 1073741824 Sep 28 15:22:38 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcf39ea-1d90-40ed-b1e1-0e2abcf7b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 (7abae38a-6224-4515-b7e9-a3a8dd183f05): created successfully Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcf39ea-1d90-40ed-b1e1-0e2abcf7b84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (4ac9a362-6a09-4b67-ad6c-355f0a1dcc4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:38 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-4571158e-4ecb-43da-964b-9dd26c1b1d3b tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created volume successfully. Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (59226df1-2256-449b-bdfb-42cea0d6b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2b7fd-cde7-4576-bd25-9b295f3adcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2b7fd-cde7-4576-bd25-9b295f3adcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37794400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2d40e7-70f0-4c53-abd5-09e35f956216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:39Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777f3c3a-6abf-4c12-bbb5-1975fc56df35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777f3c3a-6abf-4c12-bbb5-1975fc56df35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e256fe1b-d7fe-4d3d-901d-ba9093be083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e256fe1b-d7fe-4d3d-901d-ba9093be083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2d40e7-70f0-4c53-abd5-09e35f956216', 'volume_name': 'volume-1f2d40e7-70f0-4c53-abd5-09e35f956216', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc87abac-4b2d-4973-95c9-8c6f8944fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc87abac-4b2d-4973-95c9-8c6f8944fc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef92ebf-455a-4897-800c-f738547e2c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Volume 1f2d40e7-70f0-4c53-abd5-09e35f956216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2d40e7-70f0-4c53-abd5-09e35f956216', 'volume_size': 1} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 1073741824" returned: 0 in 0.520s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 Sep 28 15:22:38 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847" returned: 0 in 0.295s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.364s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347383112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1dc102c-46de-4b9a-8b6b-d60fad2ea872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4aebf81346468e806dc0ca0081adf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:36Z,use_quota=True,user_id='c4d716f376d44518b8dc21407633440a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Creating volume a1dc102c-46de-4b9a-8b6b-d60fad2ea872 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db959169-c5a7-4207-9aab-187949ba5155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9660f428-3b20-4a0c-9034-537cd5321847', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 1073741824 Sep 28 15:22:39 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f86a885-1f3c-4722-942d-15899b33ce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume volume-9660f428-3b20-4a0c-9034-537cd5321847 (9660f428-3b20-4a0c-9034-537cd5321847): created successfully Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f86a885-1f3c-4722-942d-15899b33ce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (7887a548-d130-43c2-aec7-1426ea96ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:39 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e4c9bd50-a817-4e4a-9413-5644f0529668 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created volume successfully. Sep 28 15:22:39 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 1073741824" returned: 0 in 0.473s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:39 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 Sep 28 15:22:39 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872" returned: 0 in 0.254s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.073s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f1584e-94c7-4ed6-85f1-f0e7cd72634e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c1d4d69d2a4c5e80fe40d78059c9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:37Z,use_quota=True,user_id='6cbb73a8edab4f18acbe50aa8fe4090e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Creating volume f7f1584e-94c7-4ed6-85f1-f0e7cd72634e {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:40 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5716621c-e7ba-4e9a-9c16-a0f23a37bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421d4e4d-7409-43f4-bbc3-2ecfbfc88a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:40 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e 1073741824 Sep 28 15:22:40 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Volume volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 (a1dc102c-46de-4b9a-8b6b-d60fad2ea872): created successfully Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421d4e4d-7409-43f4-bbc3-2ecfbfc88a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Flow 'volume_create_manager' (b7c159b5-8add-4da1-bd6f-4cf08f837d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:40 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-561b9224-406b-4641-81c6-f578da7a2041 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created volume successfully. Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-a1dc102c-46de-4b9a-8b6b-d60fad2ea872-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-a1dc102c-46de-4b9a-8b6b-d60fad2ea872-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-a1dc102c-46de-4b9a-8b6b-d60fad2ea872" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-a1dc102c-46de-4b9a-8b6b-d60fad2ea872" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a7299c-6d42-4063-bb2a-a00081ffd79f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e 1073741824" returned: 0 in 0.546s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 Sep 28 15:22:40 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e Sep 28 15:22:40 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872" returned: 0 in 0.410s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e" returned: 0 in 0.280s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-687744582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb397157-e6fe-4e34-a4fa-80446885fc8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:37Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Creating volume cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:40 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872 Sep 28 15:22:40 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:40 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6431b808-fa2a-4a4c-8361-b2359ff8d55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cffaba6-c80b-49ad-af18-72b90ae819ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:40 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c 1073741824 Sep 28 15:22:40 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Volume volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e (f7f1584e-94c7-4ed6-85f1-f0e7cd72634e): created successfully Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cffaba6-c80b-49ad-af18-72b90ae819ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Flow 'volume_create_manager' (bba2f6eb-b2f7-411a-a664-1512d3e73808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c5a78e68-685a-4312-bdd0-b33cbdeefe7f tempest-CinderUnicodeTest-1579580078 None] Created volume successfully. Sep 28 15:22:41 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a1dc102c-46de-4b9a-8b6b-d60fad2ea872" returned: 0 in 0.319s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-a1dc102c-46de-4b9a-8b6b-d60fad2ea872" released by "delete_volume" :: held 0.778s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created reservations ['bf0f18cb-731c-4b97-b2a1-ef4136a04b3f', '9d54afec-20c8-4f9e-9522-5f5c6bba6979', 'e4397538-a313-41d0-8470-fd4f557516c2', '26cb25c3-eef8-4bd6-bd27-a5c1d7fb3ae8'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:41 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:41 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c 1073741824" returned: 0 in 0.585s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c Sep 28 15:22:41 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-9660f428-3b20-4a0c-9034-537cd5321847-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-9660f428-3b20-4a0c-9034-537cd5321847-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-9660f428-3b20-4a0c-9034-537cd5321847" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:41 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-9660f428-3b20-4a0c-9034-537cd5321847" acquired by "delete_volume" :: waited 0.029s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:41 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Deleted volume successfully. Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e5506-8834-419f-91a3-b088142de682]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cbc0075c-5068-49f4-8cc8-f3a7d4bde3be tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-a1dc102c-46de-4b9a-8b6b-d60fad2ea872-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:41 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c" returned: 0 in 0.398s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37794400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2d40e7-70f0-4c53-abd5-09e35f956216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:39Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Creating volume 1f2d40e7-70f0-4c53-abd5-09e35f956216 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:41 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 Sep 28 15:22:42 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 1073741824 Sep 28 15:22:42 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d593b514-0ae5-4b09-8abb-554b86b02c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb397157-e6fe-4e34-a4fa-80446885fc8c', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b34d24f-8563-497d-b4f4-06708f9cbdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Flow 'volume_create_manager' (34d91abc-adfa-4533-818f-6a1bbafa579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac5210a-fd9e-4450-b1ac-91f58d00ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Volume volume-cb397157-e6fe-4e34-a4fa-80446885fc8c (cb397157-e6fe-4e34-a4fa-80446885fc8c): created successfully Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b34d24f-8563-497d-b4f4-06708f9cbdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (afeb1b5a-be69-48e3-bcd1-b50f19997a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac5210a-fd9e-4450-b1ac-91f58d00ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-676509651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f499ac-7a27-44de-b6e6-d7bcbd22f902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c1d4d69d2a4c5e80fe40d78059c9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:42Z,use_quota=True,user_id='6cbb73a8edab4f18acbe50aa8fe4090e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f7f10-08d8-46a3-966d-49c7365ea32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f7f10-08d8-46a3-966d-49c7365ea32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9dec24-6b78-40bc-a646-26a5af891b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9dec24-6b78-40bc-a646-26a5af891b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f499ac-7a27-44de-b6e6-d7bcbd22f902', 'volume_name': 'volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43db0f7-79e8-4b2d-abdb-35173ccd3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43db0f7-79e8-4b2d-abdb-35173ccd3267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40f9230-198d-43aa-b2ee-725e72766e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Volume c4f499ac-7a27-44de-b6e6-d7bcbd22f902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902', 'volume_size': 1} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1a2a3452-c35f-4986-a3a5-41922709313d tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:22:42 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847 Sep 28 15:22:42 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 1073741824" returned: 0 in 0.489s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 Sep 28 15:22:42 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-9660f428-3b20-4a0c-9034-537cd5321847" returned: 0 in 0.293s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-9660f428-3b20-4a0c-9034-537cd5321847" released by "delete_volume" :: held 0.813s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created reservations ['d30e5e3e-d70d-4fac-af5b-035cb0c81047', '1a024538-d64a-4514-80aa-7a53615c3e3a', '7ef56255-af53-4f90-b605-65233e4c4fc1', 'e6b47401-743d-4c18-b56a-ae0503a952c5'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:42 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-7abae38a-6224-4515-b7e9-a3a8dd183f05-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216" returned: 0 in 0.355s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-676509651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f499ac-7a27-44de-b6e6-d7bcbd22f902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c1d4d69d2a4c5e80fe40d78059c9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:42Z,use_quota=True,user_id='6cbb73a8edab4f18acbe50aa8fe4090e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Creating volume c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:42 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef92ebf-455a-4897-800c-f738547e2c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2d40e7-70f0-4c53-abd5-09e35f956216', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c848af5f-1940-413c-90f1-544229ee4610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-7abae38a-6224-4515-b7e9-a3a8dd183f05-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:42 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 1073741824 Sep 28 15:22:42 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Volume volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 (1f2d40e7-70f0-4c53-abd5-09e35f956216): created successfully Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c848af5f-1940-413c-90f1-544229ee4610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (59226df1-2256-449b-bdfb-42cea0d6b46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:43 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-789483e0-3122-4b47-a6e9-3500387e0b1b tempest-ProjectReaderTests-1205366221 None] Created volume successfully. Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-7abae38a-6224-4515-b7e9-a3a8dd183f05" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-7abae38a-6224-4515-b7e9-a3a8dd183f05" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6fb8d3-49d3-4472-9f09-d7649f002596]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.417s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:43 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Deleted volume successfully. Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e9de2a2-137a-45c2-9a5d-53be3515e413 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-9660f428-3b20-4a0c-9034-537cd5321847-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-1f2d40e7-70f0-4c53-abd5-09e35f956216-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:43 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 Sep 28 15:22:43 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-1f2d40e7-70f0-4c53-abd5-09e35f956216-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-quobyte-1f2d40e7-70f0-4c53-abd5-09e35f956216" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-1f2d40e7-70f0-4c53-abd5-09e35f956216" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed32ccc-201e-40ee-b250-1a840823b634]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 1073741824" returned: 0 in 0.586s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 Sep 28 15:22:43 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 Sep 28 15:22:43 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05" returned: 0 in 0.491s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05 Sep 28 15:22:43 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" returned: 0 in 0.280s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.592s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216" returned: 0 in 0.415s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216 Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot edd143f5-9b4e-4a61-9b1f-322c77572dbc of volume cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:43 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40f9230-198d-43aa-b2ee-725e72766e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66df36d-532f-471d-bfaf-a4e227b192d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4081c8be-0175-474d-a749-622d653755ff]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-7abae38a-6224-4515-b7e9-a3a8dd183f05" returned: 0 in 0.278s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Volume volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 (c4f499ac-7a27-44de-b6e6-d7bcbd22f902): created successfully Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66df36d-532f-471d-bfaf-a4e227b192d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Flow 'volume_create_manager' (34d91abc-adfa-4533-818f-6a1bbafa579f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-7abae38a-6224-4515-b7e9-a3a8dd183f05" released by "delete_volume" :: held 0.872s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:43 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b6d91470-1819-4e36-85fe-a79dcf468459 tempest-CinderUnicodeTest-1579580078 None] Created volume successfully. Sep 28 15:22:43 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c Sep 28 15:22:43 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created reservations ['130eaf1e-8d59-4075-b387-c34449c3573b', 'bafe32d7-c0b5-46f8-a7d9-4d17de42a7ef', '616480e8-662b-4761-9382-12f0e1dfdeeb', '0748a617-126f-4459-8a66-957a7de83a08'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-1f2d40e7-70f0-4c53-abd5-09e35f956216" returned: 0 in 0.309s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:44 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-1f2d40e7-70f0-4c53-abd5-09e35f956216" released by "delete_volume" :: held 0.794s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-6a2170b4-d2d3-4393-b0fc-01232e962b9e-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-6a2170b4-d2d3-4393-b0fc-01232e962b9e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-6a2170b4-d2d3-4393-b0fc-01232e962b9e" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Created reservations ['1db43bc9-6236-4175-bebc-88cb58eed54a', '034a9a5f-467c-4026-9cb0-cae74c489ca5', '20e8f5e8-d88e-4252-ace5-c44143320365', 'd3df7e66-ee29-499b-83cc-882c5942fcdb'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-6a2170b4-d2d3-4393-b0fc-01232e962b9e" acquired by "delete_volume" :: waited 0.040s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:44 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6a9aae-abfa-4362-8153-c45dc0c102ea]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c" returned: 0 in 0.603s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:44 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc 1G Sep 28 15:22:44 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Deleted volume successfully. Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0cff5306-339e-4a53-9a0c-fe2ec739dbd0 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-7abae38a-6224-4515-b7e9-a3a8dd183f05-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e Sep 28 15:22:44 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:44 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.283s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e" returned: 0 in 0.513s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Deleted volume successfully. Sep 28 15:22:44 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e Sep 28 15:22:44 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-fd2ad473-8a12-462d-9f05-adb8940c57f3 tempest-ProjectReaderTests-1205366221 None] Lock "cinder-1f2d40e7-70f0-4c53-abd5-09e35f956216-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:45 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc 1G" returned: 0 in 0.553s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb397157-e6fe-4e34-a4fa-80446885fc8c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb397157-e6fe-4e34-a4fa-80446885fc8c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc Sep 28 15:22:45 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-6a2170b4-d2d3-4393-b0fc-01232e962b9e" returned: 0 in 0.288s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-6a2170b4-d2d3-4393-b0fc-01232e962b9e" released by "delete_volume" :: held 0.901s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created reservations ['76eccd7e-9d82-4ba9-afa4-4b52a5f1c15c', 'af3224d7-6509-435f-b97b-71fef0057f87', 'e2f7c563-1652-45a8-bfb8-0b7794a6a89e', '235a7cd4-5fbf-44ed-8bdd-e18a6cfa2e0c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:45 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb397157-e6fe-4e34-a4fa-80446885fc8c -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc" returned: 0 in 0.356s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc is being set with open permissions: ugo+rw Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc Sep 28 15:22:45 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:45 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc" returned: 0 in 0.274s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.info Sep 28 15:22:45 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.302s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:45 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Deleted volume successfully. Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a25a8fb6-2ddd-4121-83db-0ca67565a463 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-6a2170b4-d2d3-4393-b0fc-01232e962b9e-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:45 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.info" returned: 0 in 0.266s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.info is being set with open permissions: ugo+rw Sep 28 15:22:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.info Sep 28 15:22:46 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (805946c0-0725-4dd2-8b00-373faaeb0085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592d06f3-801b-411a-90d1-c9de48c65187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592d06f3-801b-411a-90d1-c9de48c65187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224488288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a49fec4-f676-4ae7-897a-c15d2cb413a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:46Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed4d8c8-31aa-43ad-9608-45473143fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed4d8c8-31aa-43ad-9608-45473143fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6283a1b6-0f9e-4224-b859-dd19b55f9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6283a1b6-0f9e-4224-b859-dd19b55f9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a49fec4-f676-4ae7-897a-c15d2cb413a5', 'volume_name': 'volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba3febc-8761-451a-88a4-aa0d3cb9c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba3febc-8761-451a-88a4-aa0d3cb9c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1c8587-da9f-4fb9-8f98-8421a85eb658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Volume 3a49fec4-f676-4ae7-897a-c15d2cb413a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5', 'volume_size': 1} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.info" returned: 0 in 0.281s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.676s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Creating offline snapshot 0d6d1df7-a302-4a85-bf40-730dd52daec2 of volume c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:46 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a1caec49-ce30-456e-9d4e-1153918d3039 tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a78c66-0c53-41b6-a2b0-f810e4fd734d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 Sep 28 15:22:46 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-65ab96f2-0f91-4f57-8da1-a8ac48a645d7-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-65ab96f2-0f91-4f57-8da1-a8ac48a645d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-65ab96f2-0f91-4f57-8da1-a8ac48a645d7" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-65ab96f2-0f91-4f57-8da1-a8ac48a645d7" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb206fe-549b-43fe-a0bc-dcf40739427f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 Sep 28 15:22:46 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 1G Sep 28 15:22:46 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7" returned: 0 in 0.376s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7 Sep 28 15:22:47 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 1G" returned: 0 in 0.448s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 Sep 28 15:22:47 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-65ab96f2-0f91-4f57-8da1-a8ac48a645d7" returned: 0 in 0.269s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-65ab96f2-0f91-4f57-8da1-a8ac48a645d7" released by "delete_volume" :: held 0.691s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created reservations ['384dfb5e-4f98-42b1-a832-15ca4e9335c1', '330d1c58-3e08-4d92-98c0-b9414088ed8a', 'd2ee128a-f5d9-44a2-80b1-e4dc091e8b15', '1e364b13-da2b-4842-8aa8-6665d4fc8f74'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-edd143f5-9b4e-4a61-9b1f-322c77572dbc-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Lock "cinder-edd143f5-9b4e-4a61-9b1f-322c77572dbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-cb397157-e6fe-4e34-a4fa-80446885fc8c" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-cb397157-e6fe-4e34-a4fa-80446885fc8c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-edd143f5-9b4e-4a61-9b1f-322c77572dbc" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-edd143f5-9b4e-4a61-9b1f-322c77572dbc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot edd143f5-9b4e-4a61-9b1f-322c77572dbc of volume cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[334852c7-5a74-459d-980a-d0d80017ae70]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2" returned: 0 in 0.379s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 is being set with open permissions: ugo+rw Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 Sep 28 15:22:47 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc Sep 28 15:22:47 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-10ad581f-5f9d-4815-a789-0525040689e9-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-10ad581f-5f9d-4815-a789-0525040689e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-f75daede-4161-45ba-9f4b-01448827ca54" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-f75daede-4161-45ba-9f4b-01448827ca54" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-10ad581f-5f9d-4815-a789-0525040689e9" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-10ad581f-5f9d-4815-a789-0525040689e9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Deleting offline snapshot 10ad581f-5f9d-4815-a789-0525040689e9 of volume f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] snapshot_file for this snap is: volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7be869-1f1e-444e-90d2-6ad4e5247783]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2" returned: 0 in 0.337s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.395s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Deleted volume successfully. Sep 28 15:22:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0487ec62-6327-4659-a73c-d7287df318ab tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-65ab96f2-0f91-4f57-8da1-a8ac48a645d7-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:48 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 Sep 28 15:22:48 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.info Sep 28 15:22:48 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc" returned: 0 in 0.500s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb397157-e6fe-4e34-a4fa-80446885fc8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efadde7-539c-422c-8944-876c08e4eae8]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c Sep 28 15:22:48 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.info" returned: 0 in 0.308s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.info is being set with open permissions: ugo+rw Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9" returned: 0 in 0.467s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f75daede-4161-45ba-9f4b-01448827ca54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:48 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.info Sep 28 15:22:48 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cebba63-b92d-4e3e-871f-c4cbd8cc74de]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 Sep 28 15:22:48 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c" returned: 0 in 0.435s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc Sep 28 15:22:48 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.info" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.408s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224488288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a49fec4-f676-4ae7-897a-c15d2cb413a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290e46ec40241dc8d1aba1f2ee235f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:46Z,use_quota=True,user_id='7bedcedcf4c54a32a220f79c8c3889ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Creating volume 3a49fec4-f676-4ae7-897a-c15d2cb413a5 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:48 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 1073741824 Sep 28 15:22:48 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-db804ce4-afab-4c4a-9e7d-376bafec3092 tempest-CinderUnicodeTest-1579580078 None] Create snapshot completed successfully Sep 28 15:22:48 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54" returned: 0 in 0.435s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 Sep 28 15:22:48 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc" returned: 0 in 0.385s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc Sep 28 15:22:48 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9" returned: 0 in 0.365s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9 Sep 28 15:22:49 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 1073741824" returned: 0 in 0.519s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 Sep 28 15:22:49 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c.edd143f5-9b4e-4a61-9b1f-322c77572dbc" returned: 0 in 0.331s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-edd143f5-9b4e-4a61-9b1f-322c77572dbc" released by "_delete_snapshot" :: held 1.814s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-cb397157-e6fe-4e34-a4fa-80446885fc8c" released by "delete_snapshot" :: held 1.843s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Created reservations ['3ee69a53-0835-4994-8631-0d1d23865962', '65305ef6-fcf3-4935-870b-30513f8375c4', 'd38c49bb-cd69-4409-a3ff-5b212aeec211', '3d1f48a2-69ec-4ab9-8663-c6eca58f66a7'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:49 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54.10ad581f-5f9d-4815-a789-0525040689e9" returned: 0 in 0.296s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2d54aab4-493a-4cd6-a567-692e098b94fe tempest-ProjectMemberTests-1666069766 None] Lock "cinder-edd143f5-9b4e-4a61-9b1f-322c77572dbc-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-10ad581f-5f9d-4815-a789-0525040689e9" released by "_delete_snapshot" :: held 1.701s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5" returned: 0 in 0.273s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-f75daede-4161-45ba-9f4b-01448827ca54" released by "delete_snapshot" :: held 1.732s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1c8587-da9f-4fb9-8f98-8421a85eb658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0887bc0c-297a-4832-829d-d23a1d2d5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:49 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Volume volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 (3a49fec4-f676-4ae7-897a-c15d2cb413a5): created successfully Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0887bc0c-297a-4832-829d-d23a1d2d5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Flow 'volume_create_manager' (805946c0-0725-4dd2-8b00-373faaeb0085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-aec354c0-4936-41c7-8645-c60300b5ea1b tempest-ProjectReaderTests-1205366221 None] Created volume successfully. Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created reservations ['7ff24311-eadb-4ed8-9dcb-90697298adc4', '87bfdfd2-e5b3-4ae9-a740-31c60ee72cb2', 'ad584212-9289-40d2-8130-663f82654ac5', 'a9455465-5e14-41e1-b965-6aa51a8dcc6e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-cb397157-e6fe-4e34-a4fa-80446885fc8c-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-cb397157-e6fe-4e34-a4fa-80446885fc8c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Delete snapshot completed successfully. Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-dff9d43e-3645-4227-b8fe-6b074d610578 tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-10ad581f-5f9d-4815-a789-0525040689e9-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-cb397157-e6fe-4e34-a4fa-80446885fc8c" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-cb397157-e6fe-4e34-a4fa-80446885fc8c" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72656f5-2e94-41dd-ac38-0bcd6b9e1de1]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "cinder-0d6d1df7-a302-4a85-bf40-730dd52daec2-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-0d6d1df7-a302-4a85-bf40-730dd52daec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "cinder-quobyte-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "cinder-quobyte-0d6d1df7-a302-4a85-bf40-730dd52daec2" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-0d6d1df7-a302-4a85-bf40-730dd52daec2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Deleting offline snapshot 0d6d1df7-a302-4a85-bf40-730dd52daec2 of volume c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:49 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c Sep 28 15:22:49 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] snapshot_file for this snap is: volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f632d0c-2ab4-4300-9e18-aaa7aaec1a3c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-f75daede-4161-45ba-9f4b-01448827ca54-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-f75daede-4161-45ba-9f4b-01448827ca54-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "cinder-quobyte-f75daede-4161-45ba-9f4b-01448827ca54" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-f75daede-4161-45ba-9f4b-01448827ca54" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 Sep 28 15:22:50 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f79f680-ba27-4136-8af9-96841030b6a3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c" returned: 0 in 0.396s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c Sep 28 15:22:50 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 Sep 28 15:22:50 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2" returned: 0 in 0.439s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c9cab3-f3ad-4839-a385-abf8c0b261bb]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-cb397157-e6fe-4e34-a4fa-80446885fc8c" returned: 0 in 0.314s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-3a49fec4-f676-4ae7-897a-c15d2cb413a5-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:50 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-cb397157-e6fe-4e34-a4fa-80446885fc8c" released by "delete_volume" :: held 0.803s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54" returned: 0 in 0.437s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Lock "cinder-3a49fec4-f676-4ae7-897a-c15d2cb413a5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54 Sep 28 15:22:50 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 Sep 28 15:22:50 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Acquiring lock "cinder-quobyte-3a49fec4-f676-4ae7-897a-c15d2cb413a5" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-3a49fec4-f676-4ae7-897a-c15d2cb413a5" acquired by "delete_volume" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Created reservations ['28948f3a-7e7c-484b-bd7a-7884b12a272f', '5c4b51ac-650c-4c40-a8d1-59a4752720c3', '87b8d41f-24cb-4b4e-89f2-ab6b62402738', 'b43649a3-cf83-459f-beef-8d0af6a51886'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d107b03-e548-486b-99c8-0e1aeff50e05]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:50 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 Sep 28 15:22:50 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f75daede-4161-45ba-9f4b-01448827ca54" returned: 0 in 0.354s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-quobyte-f75daede-4161-45ba-9f4b-01448827ca54" released by "delete_volume" :: held 0.875s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:50 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" returned: 0 in 0.551s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Created reservations ['18131d8e-56c0-46ca-8d8b-9b5ca1ff037b', 'bc93a37f-b0c9-40aa-9a8d-1667b7e60cdf', 'b76165b6-4029-4869-bb0f-919d32525452', '14289334-85b4-45ac-b7a3-9fd2dbcfb22a'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:51 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 Sep 28 15:22:51 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.376s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:51 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:51 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-96f1e791-41f5-4c49-9158-bb35268db008 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-cb397157-e6fe-4e34-a4fa-80446885fc8c-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5" returned: 0 in 0.552s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5 Sep 28 15:22:51 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.392s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Deleted volume successfully. Sep 28 15:22:51 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2" returned: 0 in 0.551s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-785d9f82-7682-4c87-a59f-1132ea00e1ee tempest-CreateVolumesFromSnapshotTest-2072257415 None] Lock "cinder-f75daede-4161-45ba-9f4b-01448827ca54-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2 Sep 28 15:22:51 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-3a49fec4-f676-4ae7-897a-c15d2cb413a5" returned: 0 in 0.455s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Lock "cinder-quobyte-3a49fec4-f676-4ae7-897a-c15d2cb413a5" released by "delete_volume" :: held 1.071s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (1656eba8-e705-4a82-ac6e-f5632de55c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba549c7-a357-4085-aa77-48561d026383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba549c7-a357-4085-aa77-48561d026383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497499261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b51cdc8-c58a-4e17-9b12-2b20595577fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:52Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d1d152-6778-4d71-b54c-6165557b5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d1d152-6778-4d71-b54c-6165557b5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f497558-f82d-49ce-877a-0a9a85900e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f497558-f82d-49ce-877a-0a9a85900e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b51cdc8-c58a-4e17-9b12-2b20595577fd', 'volume_name': 'volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cd4ec1-073d-445b-a798-bdcb93d9f708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cd4ec1-073d-445b-a798-bdcb93d9f708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47672867-d782-4cc8-a7a9-15c4816d9f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:51 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Volume 5b51cdc8-c58a-4e17-9b12-2b20595577fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd', 'volume_size': 1} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497499261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b51cdc8-c58a-4e17-9b12-2b20595577fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:52Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Creating volume 5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:51 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd 1073741824 Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Created reservations ['9e10415a-1d5a-4ca5-a6f3-c18bbd87142f', '5d19486d-95c9-4db9-b2c2-cc130272af70', '1f49179b-2d09-434d-8420-793cf32c5298', 'a527b715-df29-4d50-bba9-4d3311a2e6c2'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:51 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902.0d6d1df7-a302-4a85-bf40-730dd52daec2" returned: 0 in 0.386s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-0d6d1df7-a302-4a85-bf40-730dd52daec2" released by "_delete_snapshot" :: held 2.088s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" released by "delete_snapshot" :: held 2.138s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:52 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Created reservations ['68f74e6a-534d-437b-999c-8c593da5c013', 'f5e62cc2-24dd-44bd-8bc4-bd28bc83dd04', '44a106dc-3714-40f8-bd38-4c88ca0a75b7', '2a4d4631-5ffa-4697-87e5-34f1f9ae87a9'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Delete snapshot completed successfully. Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ff05fb86-635a-4734-8b89-444576a03cbc tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-0d6d1df7-a302-4a85-bf40-730dd52daec2-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.311s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Deleted volume successfully. Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-cc197bd4-50a9-44ea-a160-ab15771a1deb tempest-ProjectReaderTests-1205366221 None] Lock "cinder-3a49fec4-f676-4ae7-897a-c15d2cb413a5-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd 1073741824" returned: 0 in 0.544s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:52 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd Sep 28 15:22:52 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd" returned: 0 in 0.260s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47672867-d782-4cc8-a7a9-15c4816d9f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab44f76b-159c-481b-a458-fff316e8dc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:52 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Volume volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd (5b51cdc8-c58a-4e17-9b12-2b20595577fd): created successfully Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab44f76b-159c-481b-a458-fff316e8dc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:52 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (1656eba8-e705-4a82-ac6e-f5632de55c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6334e9bf-5a76-4086-84a1-998856dd57f7 tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "cinder-c4f499ac-7a27-44de-b6e6-d7bcbd22f902-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-c4f499ac-7a27-44de-b6e6-d7bcbd22f902-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "cinder-quobyte-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12863a5-9f07-4ead-a695-53c9d013c60a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:53 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 Sep 28 15:22:53 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:53 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" returned: 0 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:53 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902 Sep 28 15:22:53 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:53 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" returned: 0 in 0.343s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 of volume 5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-c4f499ac-7a27-44de-b6e6-d7bcbd22f902" released by "delete_volume" :: held 0.851s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e90d127-dcae-4471-a09a-e1660c37738e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=217,cinder:UPDATE=312,cinder:INSERT=76,cinder:DELETE=28 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Created reservations ['0a8126d6-f381-413f-bb3e-98160d7a01ac', 'bb25c334-7efe-487e-b167-f61b03b911d8', 'ad3711d2-aa0f-4b68-927f-188d5fb14087', '11f0bd45-16cb-4d56-a58b-543d293d6422'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:54 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd Sep 28 15:22:54 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:54 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "cinder-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=244,cinder:UPDATE=327,cinder:INSERT=86,cinder:DELETE=29 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "cinder-quobyte-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:54 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.348s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:54 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Deleted volume successfully. Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a36a8b-56c2-4113-bb3a-f219f877cafe]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-5d28fd9a-d212-4bbf-9069-35c2b75eb994 tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-c4f499ac-7a27-44de-b6e6-d7bcbd22f902-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd" returned: 0 in 0.603s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:54 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 1G Sep 28 15:22:54 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:54 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e Sep 28 15:22:54 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e" returned: 0 in 0.572s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e Sep 28 15:22:55 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 1G" returned: 0 in 0.637s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 Sep 28 15:22:55 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e" returned: 0 in 0.406s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-quobyte-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e" released by "delete_volume" :: held 1.046s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Created reservations ['90e061fc-a3c5-4e4f-93ab-291c6c4d53dc', '834534f1-8c5f-4520-a58f-352ad36b08f8', '974ea7de-39f6-411f-876e-935c32c1bd10', 'a1730f97-2e15-4ecb-9fbb-de711d155427'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:55 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" returned: 0 in 0.499s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 is being set with open permissions: ugo+rw Sep 28 15:22:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:22:55 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 Sep 28 15:22:55 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.273s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Deleted volume successfully. Sep 28 15:22:56 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" returned: 0 in 0.287s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a87d93eb-aa88-4e22-9543-68df3bf1075d tempest-CinderUnicodeTest-1579580078 None] Lock "cinder-f7f1584e-94c7-4ed6-85f1-f0e7cd72634e-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.info Sep 28 15:22:56 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.info" returned: 0 in 0.256s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.info is being set with open permissions: ugo+rw Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.info Sep 28 15:22:56 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.info" returned: 0 in 0.321s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-98af6a95-127c-42aa-87ce-1795b236d6e3 tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-0ee10d0c-0d7a-471f-a1e7-4ce941eb1101-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-0ee10d0c-0d7a-471f-a1e7-4ce941eb1101-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-5b51cdc8-c58a-4e17-9b12-2b20595577fd" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-5b51cdc8-c58a-4e17-9b12-2b20595577fd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 of volume 5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[973063f7-bf65-462b-9b3d-bca03d62527c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 Sep 28 15:22:57 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:57 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" returned: 0 in 0.456s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d1642-bec8-4601-b670-7c3b3371c94e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd Sep 28 15:22:57 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd" returned: 0 in 0.447s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 Sep 28 15:22:58 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" returned: 0 in 0.398s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101 Sep 28 15:22:58 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd.0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" returned: 0 in 0.323s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Flow 'volume_create_manager' (470e2fa1-2abb-4c80-83a4-dd678adbea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07284ad2-cd94-4e85-8df3-64eed2ef7c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-0ee10d0c-0d7a-471f-a1e7-4ce941eb1101" released by "_delete_snapshot" :: held 1.795s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-5b51cdc8-c58a-4e17-9b12-2b20595577fd" released by "delete_snapshot" :: held 1.822s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07284ad2-cd94-4e85-8df3-64eed2ef7c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69861c29-fc31-4709-8b17-0a569b0e3283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd17f13d5104c1ab5b09487191ffb0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:59Z,use_quota=True,user_id='99ff7a53505a417e8a8df58010f8bc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcceab7-4d85-4e14-9345-c95248a43fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcceab7-4d85-4e14-9345-c95248a43fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd86cafe-2764-47f4-8a31-ffa0534c3f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack cinder-volume[86384]: DEBUG cinder.image.glance [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Creating Keystone auth plugin from conf {{(pid=86384) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Created reservations ['a42e746e-60ab-4c1a-be95-fa84c856ebd4', 'cc8bdf6b-828f-4aa0-b193-7d6a8fd578cb', '6b89dca2-53ad-4cea-9d22-a156a24b5d9f', 'b8b39f97-69e9-4acf-8446-6c28881cf2e6'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:59 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2b56c584-bee2-44b7-a363-619b7ca771f9 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-0ee10d0c-0d7a-471f-a1e7-4ce941eb1101-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-5b51cdc8-c58a-4e17-9b12-2b20595577fd-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-5b51cdc8-c58a-4e17-9b12-2b20595577fd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-5b51cdc8-c58a-4e17-9b12-2b20595577fd" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-5b51cdc8-c58a-4e17-9b12-2b20595577fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd86cafe-2764-47f4-8a31-ffa0534c3f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69861c29-fc31-4709-8b17-0a569b0e3283', 'volume_name': 'volume-69861c29-fc31-4709-8b17-0a569b0e3283', 'volume_size': 1, 'image_id': '451a3bac-845b-4ab2-b059-de8fdfa949f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/451a3bac-845b-4ab2-b059-de8fdfa949f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d2b887e62204b26f208fcf9421a5196', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0cd17f13d5104c1ab5b09487191ffb0c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a93b59295a47a66289d32a52c0c14024e8e5acd5799af7adfa3972a735ce8d131fa98d45598fb5f45d64d4d803022719f9b0e6b20dfc83e544cdb026899b95d2', 'id': '451a3bac-845b-4ab2-b059-de8fdfa949f5', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/451a3bac-845b-4ab2-b059-de8fdfa949f5/file', 'properties': {}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655d401e-3b4f-4ce0-9f0d-759e8bbc843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655d401e-3b4f-4ce0-9f0d-759e8bbc843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d104046b-795f-4edd-9447-8275a2c7265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:59 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Volume 69861c29-fc31-4709-8b17-0a569b0e3283: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69861c29-fc31-4709-8b17-0a569b0e3283', 'volume_size': 1, 'image_id': '451a3bac-845b-4ab2-b059-de8fdfa949f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/451a3bac-845b-4ab2-b059-de8fdfa949f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d2b887e62204b26f208fcf9421a5196', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0cd17f13d5104c1ab5b09487191ffb0c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a93b59295a47a66289d32a52c0c14024e8e5acd5799af7adfa3972a735ce8d131fa98d45598fb5f45d64d4d803022719f9b0e6b20dfc83e544cdb026899b95d2', 'id': '451a3bac-845b-4ab2-b059-de8fdfa949f5', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/451a3bac-845b-4ab2-b059-de8fdfa949f5/file', 'properties': {}}, 'image_service': } Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Trying to clone 69861c29-fc31-4709-8b17-0a569b0e3283 from image 451a3bac-845b-4ab2-b059-de8fdfa949f5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/451a3bac-845b-4ab2-b059-de8fdfa949f5', 'metadata': {}}]). {{(pid=86384) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf129d82-e60c-48df-8fca-9233bd01e04d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:22:59 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:22:59 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd Sep 28 15:22:59 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9a6728-eb8f-489a-835a-4a82e0bdffbd]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD Sep 28 15:22:59 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd" returned: 0 in 0.427s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:59 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd Sep 28 15:22:59 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD Sep 28 15:23:00 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5b51cdc8-c58a-4e17-9b12-2b20595577fd" returned: 0 in 0.263s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-5b51cdc8-c58a-4e17-9b12-2b20595577fd" released by "delete_volume" :: held 0.776s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Created reservations ['8c54b272-8746-49e6-b13a-a75a71112a02', '0e631a47-aa40-4b3d-a858-780d2f58a4fa', '6d9b0da0-22a6-4e44-8a4c-516e2618f0c0', 'f55cfe7e-0926-4142-a612-2aa4f861fc9a'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:00 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Temporary image 451a3bac-845b-4ab2-b059-de8fdfa949f5 is fetched for user 99ff7a53505a417e8a8df58010f8bc9e. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:00 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8038524f-8a6c-448b-b384-89884d44651e]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD Sep 28 15:23:00 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.292s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:00 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f24a9cbe-4c4a-43dc-b869-6f9167a60f0d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-5b51cdc8-c58a-4e17-9b12-2b20595577fd-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:00 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD Sep 28 15:23:01 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (6cae8dfd-c580-4806-9810-1fceebdaa047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acaa8c3-6b87-4bb7-a1b0-0c942a459129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acaa8c3-6b87-4bb7-a1b0-0c942a459129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1962250881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f24ecaa-7abc-4f4e-a933-44160dc9e6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:01Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6f7fc3-8c9a-4e3e-8f04-08363d1d61a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6f7fc3-8c9a-4e3e-8f04-08363d1d61a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de6e604-9a6e-46d4-982c-0cdcde1e3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de6e604-9a6e-46d4-982c-0cdcde1e3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f24ecaa-7abc-4f4e-a933-44160dc9e6e8', 'volume_name': 'volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4018e719-dc04-4583-b173-d79d73e08ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4018e719-dc04-4583-b173-d79d73e08ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad0256c-9519-4b31-82ed-dec4ddab271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Volume 4f24ecaa-7abc-4f4e-a933-44160dc9e6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8', 'volume_size': 1} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1962250881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f24ecaa-7abc-4f4e-a933-44160dc9e6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:01Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Creating volume 4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 1073741824 Sep 28 15:23:01 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 1073741824" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 Sep 28 15:23:01 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" returned: 0 in 0.255s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69861c29-fc31-4709-8b17-0a569b0e3283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd17f13d5104c1ab5b09487191ffb0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:59Z,use_quota=True,user_id='99ff7a53505a417e8a8df58010f8bc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Creating volume 69861c29-fc31-4709-8b17-0a569b0e3283 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:01 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad0256c-9519-4b31-82ed-dec4ddab271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe2b8fb-617a-46c6-968a-4a04054fc4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:02 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 1073741824 Sep 28 15:23:02 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Volume volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 (4f24ecaa-7abc-4f4e-a933-44160dc9e6e8): created successfully Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe2b8fb-617a-46c6-968a-4a04054fc4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (6cae8dfd-c580-4806-9810-1fceebdaa047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f750d966-26fd-41f1-95f6-fb7338a732fc tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:23:02 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 1073741824" returned: 0 in 0.533s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 Sep 28 15:23:02 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283" returned: 0 in 0.270s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Attempting download of 451a3bac-845b-4ab2-b059-de8fdfa949f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/451a3bac-845b-4ab2-b059-de8fdfa949f5', 'metadata': {}}])) to volume 69861c29-fc31-4709-8b17-0a569b0e3283. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904675d-fdab-407e-bece-c73a66c74941]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_451a3bac-845b-4ab2-b059-de8fdfa949f5_4hsbfjxw {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_451a3bac-845b-4ab2-b059-de8fdfa949f5_4hsbfjxw Sep 28 15:23:03 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_451a3bac-845b-4ab2-b059-de8fdfa949f5_4hsbfjxw" returned: 0 in 0.366s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_451a3bac-845b-4ab2-b059-de8fdfa949f5_4hsbfjxw {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_451a3bac-845b-4ab2-b059-de8fdfa949f5_4hsbfjxw Sep 28 15:23:03 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 05a75052-b6c8-4efb-99d9-3f6d3afc4e85 of volume 4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a4b489-9778-407e-ae93-12ae9eb0c777]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 Sep 28 15:23:03 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_451a3bac-845b-4ab2-b059-de8fdfa949f5_4hsbfjxw" returned: 1 in 0.375s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_451a3bac-845b-4ab2-b059-de8fdfa949f5_4hsbfjxw' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67cf8be-3932-44bf-ae07-2bdc61f87ad5]: (4, 'raw') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD Sep 28 15:23:03 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" returned: 0 in 0.410s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 1G Sep 28 15:23:03 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD Sep 28 15:23:04 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 1G" returned: 0 in 0.470s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] 451a3bac-845b-4ab2-b059-de8fdfa949f5 was raw, converting to qcow2 {{(pid=86384) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 Sep 28 15:23:04 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 Sep 28 15:23:04 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85" returned: 0 in 0.338s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 is being set with open permissions: ugo+rw Sep 28 15:23:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 Sep 28 15:23:04 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283" returned: 0 in 0.595s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_451a3bac-845b-4ab2-b059-de8fdfa949f5_y1fptkcudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:23:05 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85" returned: 0 in 0.302s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 1G Sep 28 15:23:05 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.info Sep 28 15:23:05 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.info" returned: 0 in 0.301s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.info is being set with open permissions: ugo+rw Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 1G" returned: 0 in 0.362s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Downloaded image 451a3bac-845b-4ab2-b059-de8fdfa949f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/451a3bac-845b-4ab2-b059-de8fdfa949f5', 'metadata': {}}])) to volume 69861c29-fc31-4709-8b17-0a569b0e3283 successfully. {{(pid=86384) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Temporary image 451a3bac-845b-4ab2-b059-de8fdfa949f5 for user 99ff7a53505a417e8a8df58010f8bc9e is deleted. {{(pid=86384) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.volume_utils [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Marking volume 69861c29-fc31-4709-8b17-0a569b0e3283 as bootable. {{(pid=86384) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:23:05 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.info Sep 28 15:23:05 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Copying metadata from image 451a3bac-845b-4ab2-b059-de8fdfa949f5 to 69861c29-fc31-4709-8b17-0a569b0e3283. {{(pid=86384) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Creating volume glance metadata for volume 69861c29-fc31-4709-8b17-0a569b0e3283 backed by image 451a3bac-845b-4ab2-b059-de8fdfa949f5 with: {'image_id': '451a3bac-845b-4ab2-b059-de8fdfa949f5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5d2b887e62204b26f208fcf9421a5196', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86384) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d104046b-795f-4edd-9447-8275a2c7265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69861c29-fc31-4709-8b17-0a569b0e3283', 'volume_size': 1, 'image_id': '451a3bac-845b-4ab2-b059-de8fdfa949f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/451a3bac-845b-4ab2-b059-de8fdfa949f5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d2b887e62204b26f208fcf9421a5196', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0cd17f13d5104c1ab5b09487191ffb0c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a93b59295a47a66289d32a52c0c14024e8e5acd5799af7adfa3972a735ce8d131fa98d45598fb5f45d64d4d803022719f9b0e6b20dfc83e544cdb026899b95d2', 'id': '451a3bac-845b-4ab2-b059-de8fdfa949f5', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/451a3bac-845b-4ab2-b059-de8fdfa949f5/file', 'properties': {}}, 'image_service': }' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0d9ac4-2717-4202-b27d-b2582799b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Volume volume-69861c29-fc31-4709-8b17-0a569b0e3283 (69861c29-fc31-4709-8b17-0a569b0e3283): created successfully Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0d9ac4-2717-4202-b27d-b2582799b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Flow 'volume_create_manager' (470e2fa1-2abb-4c80-83a4-dd678adbea3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d817b709-0e20-4b6e-9161-d523c6262e22 tempest-VolumeImageDependencyTests-1943660640 None] Created volume successfully. Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (77fe5cce-8f51-43eb-8509-6a0c42a74fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ad3ed3-6a5a-4acb-85e3-b7b494ee0461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ad3ed3-6a5a-4acb-85e3-b7b494ee0461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353663740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4f258c-874a-439c-8be0-c43dea071099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:06Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17991fd-ac4d-4603-aab4-c70198acf7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17991fd-ac4d-4603-aab4-c70198acf7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27428e6-5bfc-44fb-a6dd-b1d0204ca9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27428e6-5bfc-44fb-a6dd-b1d0204ca9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4f258c-874a-439c-8be0-c43dea071099', 'volume_name': 'volume-bd4f258c-874a-439c-8be0-c43dea071099', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01458617-a059-45fd-91d5-f6c892cc1c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01458617-a059-45fd-91d5-f6c892cc1c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:05 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953a7f94-54fe-4c69-84c7-d7c7ed879322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Volume bd4f258c-874a-439c-8be0-c43dea071099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4f258c-874a-439c-8be0-c43dea071099', 'volume_size': 1} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.info" returned: 0 in 0.300s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353663740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4f258c-874a-439c-8be0-c43dea071099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:06Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Creating volume bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:05 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 1073741824 Sep 28 15:23:05 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a0dd3e6f-2010-4523-853a-1c898b40dfe5 tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:23:06 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 1073741824" returned: 0 in 0.396s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 Sep 28 15:23:06 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099" returned: 0 in 0.238s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953a7f94-54fe-4c69-84c7-d7c7ed879322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4f258c-874a-439c-8be0-c43dea071099', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2850661-e74b-4e5c-979a-40209751c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:06 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Volume volume-bd4f258c-874a-439c-8be0-c43dea071099 (bd4f258c-874a-439c-8be0-c43dea071099): created successfully Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2850661-e74b-4e5c-979a-40209751c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (77fe5cce-8f51-43eb-8509-6a0c42a74fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1553c3ec-ca4c-4922-800d-f7b4acea314d tempest-ProjectReaderTests-2027499807 None] Created volume successfully. Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Acquiring lock "cinder-69861c29-fc31-4709-8b17-0a569b0e3283-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Lock "cinder-69861c29-fc31-4709-8b17-0a569b0e3283-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Acquiring lock "cinder-quobyte-69861c29-fc31-4709-8b17-0a569b0e3283" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Lock "cinder-quobyte-69861c29-fc31-4709-8b17-0a569b0e3283" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d7dd59-de3d-4fe5-9ee5-b526b4473272]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-05a75052-b6c8-4efb-99d9-3f6d3afc4e85-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-05a75052-b6c8-4efb-99d9-3f6d3afc4e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-05a75052-b6c8-4efb-99d9-3f6d3afc4e85" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:06 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 Sep 28 15:23:06 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-05a75052-b6c8-4efb-99d9-3f6d3afc4e85" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 05a75052-b6c8-4efb-99d9-3f6d3afc4e85 of volume 4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4541c3f4-540a-4e6c-96cd-13b4f1fd69dd]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Creating offline snapshot 9786006a-4746-43e9-bbf2-2869dd888fac of volume bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c928d440-df1f-4207-b0c0-6caf6ef31f0e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 Sep 28 15:23:06 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283" returned: 0 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 Sep 28 15:23:07 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283 Sep 28 15:23:07 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85" returned: 0 in 0.406s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[293cebac-6416-4a94-b0a8-93b76fe6af1b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-69861c29-fc31-4709-8b17-0a569b0e3283" returned: 0 in 0.262s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099" returned: 0 in 0.395s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Lock "cinder-quobyte-69861c29-fc31-4709-8b17-0a569b0e3283" released by "delete_volume" :: held 0.762s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:07 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac 1G Sep 28 15:23:07 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 Sep 28 15:23:07 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Created reservations ['727c3702-925a-4cb5-991f-5b59542ce6e2', '19ab0b29-52a0-4419-948a-d40f9c22a2df', '4d0dda1c-a896-4651-bf69-fe1955845f12', 'abb1c5c2-f97f-4f54-af9b-acbca39a2168'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:07 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" returned: 0 in 0.425s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 Sep 28 15:23:07 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.303s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:07 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Deleted volume successfully. Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b395e353-68d3-44f5-8093-ad3ff03a5baf tempest-VolumeImageDependencyTests-1943660640 None] Lock "cinder-69861c29-fc31-4709-8b17-0a569b0e3283-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:07 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac 1G" returned: 0 in 0.549s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4f258c-874a-439c-8be0-c43dea071099 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4f258c-874a-439c-8be0-c43dea071099 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac Sep 28 15:23:07 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85" returned: 0 in 0.428s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85 Sep 28 15:23:08 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4f258c-874a-439c-8be0-c43dea071099 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac" returned: 0 in 0.360s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac is being set with open permissions: ugo+rw Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac Sep 28 15:23:08 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8.05a75052-b6c8-4efb-99d9-3f6d3afc4e85" returned: 0 in 0.271s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-05a75052-b6c8-4efb-99d9-3f6d3afc4e85" released by "_delete_snapshot" :: held 1.656s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" released by "delete_snapshot" :: held 1.692s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Created reservations ['ed011b2f-354f-4490-8a11-d8275d2f2989', '232dae89-1721-479a-89ee-c7a036f75eaa', 'f72dfcdb-5ae4-484f-b63a-28c192c70d5a', 'e5495bf0-6f04-4663-9bb8-2a7e628e08db'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:08 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac" returned: 0 in 0.291s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.info Sep 28 15:23:08 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-2da958c8-7ca0-4000-8055-5749a3f032a3 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-05a75052-b6c8-4efb-99d9-3f6d3afc4e85-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:08 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.info" returned: 0 in 0.299s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.info is being set with open permissions: ugo+rw Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:08 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.info Sep 28 15:23:08 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:08 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c518868-687e-4062-a2fa-b3d6ad573f0f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.info" returned: 0 in 0.337s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 Sep 28 15:23:09 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:09 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b04eb0b6-95a7-4110-88ad-09201af032e7 tempest-ProjectReaderTests-2027499807 None] Create snapshot completed successfully Sep 28 15:23:09 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" returned: 0 in 0.454s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8 Sep 28 15:23:09 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:09 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" returned: 0 in 0.277s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8" released by "delete_volume" :: held 0.812s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Created reservations ['1d2a812a-7ed2-439d-a992-3dd2b925bc97', '10a59c7f-6e48-4297-9436-84fdda8f0d61', '7516594a-d847-442a-bb97-33181fcb994f', '4344412e-d204-4ea1-a5f2-3c70fa200434'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:09 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.332s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a03ce889-c468-4d7d-ae8c-34cfbcf718c8 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-4f24ecaa-7abc-4f4e-a933-44160dc9e6e8-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-9786006a-4746-43e9-bbf2-2869dd888fac-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Lock "cinder-9786006a-4746-43e9-bbf2-2869dd888fac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-bd4f258c-874a-439c-8be0-c43dea071099" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-bd4f258c-874a-439c-8be0-c43dea071099" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-9786006a-4746-43e9-bbf2-2869dd888fac" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-9786006a-4746-43e9-bbf2-2869dd888fac" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Deleting offline snapshot 9786006a-4746-43e9-bbf2-2869dd888fac of volume bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] snapshot_file for this snap is: volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b356f-f3b9-41db-9292-9fe44a4e1501]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (285c6ceb-7a78-45a6-9501-812570169f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:10 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac Sep 28 15:23:10 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66675e9-5447-4a49-98b7-db8b2d6912bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66675e9-5447-4a49-98b7-db8b2d6912bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436221994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ddd8ae-7d43-4841-b08c-052e1ff61921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:11Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16b812f-27ed-4589-a95f-6fe1b687e591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16b812f-27ed-4589-a95f-6fe1b687e591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb535c44-19ca-46bb-acd6-85c1925ee7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb535c44-19ca-46bb-acd6-85c1925ee7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ddd8ae-7d43-4841-b08c-052e1ff61921', 'volume_name': 'volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d6ac8e-f599-4f16-956b-9fdc81270b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d6ac8e-f599-4f16-956b-9fdc81270b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a058f0-7354-4205-a6df-f7a41dad7166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:10 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Volume f7ddd8ae-7d43-4841-b08c-052e1ff61921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921', 'volume_size': 1} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436221994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ddd8ae-7d43-4841-b08c-052e1ff61921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:11Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Creating volume f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:10 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 1073741824 Sep 28 15:23:10 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac" returned: 0 in 0.452s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4f258c-874a-439c-8be0-c43dea071099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[acee29e6-9c85-467b-9d79-5b91acbaad1c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 Sep 28 15:23:11 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 1073741824" returned: 0 in 0.504s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 Sep 28 15:23:11 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099" returned: 0 in 0.430s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac Sep 28 15:23:11 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921" returned: 0 in 0.291s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a058f0-7354-4205-a6df-f7a41dad7166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cab815-7200-494a-82ba-f8aa9cfe8962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:11 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Volume volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 (f7ddd8ae-7d43-4841-b08c-052e1ff61921): created successfully Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cab815-7200-494a-82ba-f8aa9cfe8962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (285c6ceb-7a78-45a6-9501-812570169f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-6472eed2-9c2a-436a-837e-8f0e60b068b5 tempest-ProjectAdminTests-462469806 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86384) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:23:11 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e60c3bcf-6eb7-426c-bcf8-7aecbbea3edb tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:23:11 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac Sep 28 15:23:11 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:12 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099.9786006a-4746-43e9-bbf2-2869dd888fac" returned: 0 in 0.288s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-9786006a-4746-43e9-bbf2-2869dd888fac" released by "_delete_snapshot" :: held 1.697s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-bd4f258c-874a-439c-8be0-c43dea071099" released by "delete_snapshot" :: held 1.731s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Created reservations ['7bbfd03f-7daf-43dc-9699-48af32dd22fc', 'a8b25eee-644e-40bf-8629-5814d6ca66ed', '6e4b29bd-5bc9-4476-882e-0a410c7562ba', '27c1e13b-573e-4a47-8b5f-77ebcaff8b9e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:12 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Delete snapshot completed successfully. Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6ec8dc3b-e2ff-49f3-bd39-55cd81ae18ab tempest-ProjectReaderTests-2027499807 None] Lock "cinder-9786006a-4746-43e9-bbf2-2869dd888fac-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-bd4f258c-874a-439c-8be0-c43dea071099-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Lock "cinder-bd4f258c-874a-439c-8be0-c43dea071099-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-bd4f258c-874a-439c-8be0-c43dea071099" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-bd4f258c-874a-439c-8be0-c43dea071099" acquired by "delete_volume" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d54e082-3fe6-44c5-b167-7e02f908209e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:12 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:12 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 Sep 28 15:23:12 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 0e4bd619-dced-4483-bc4a-e4563cf0be97 of volume f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9a2a2-69ef-47f5-846a-d97384ad10f5]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 Sep 28 15:23:13 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099" returned: 0 in 0.476s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099 Sep 28 15:23:13 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921" returned: 0 in 0.454s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 1G Sep 28 15:23:13 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-bd4f258c-874a-439c-8be0-c43dea071099" returned: 0 in 0.333s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-bd4f258c-874a-439c-8be0-c43dea071099" released by "delete_volume" :: held 0.887s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Created reservations ['495b9303-93f3-49ef-872e-ba7feeb9ee5a', '30e0ce3d-935d-4ba3-8a9b-1e658d572cf7', 'd08a1fe4-cc2c-4143-93dd-ac6448e62709', '04a384ff-41f6-4fb9-be8d-be0d1c6f0c80'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:13 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:13 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 1G" returned: 0 in 0.551s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:14 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 Sep 28 15:23:14 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.361s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:14 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Deleted volume successfully. Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-009dbadd-2e78-4381-aa97-c0bcdc9a210b tempest-ProjectReaderTests-2027499807 None] Lock "cinder-bd4f258c-874a-439c-8be0-c43dea071099-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (1f846864-4b9c-4d03-be8a-211dc5bbc1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7665288-ebf4-4979-a304-34230925b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7665288-ebf4-4979-a304-34230925b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279822028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744006de-4740-4370-b233-78295b681b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:14Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b95f50e-72ee-413d-a8e7-cc32f12ea173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b95f50e-72ee-413d-a8e7-cc32f12ea173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2523ef5a-ff89-4a97-b91d-3e42e152e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2523ef5a-ff89-4a97-b91d-3e42e152e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744006de-4740-4370-b233-78295b681b66', 'volume_name': 'volume-744006de-4740-4370-b233-78295b681b66', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fcb0e8-589b-4a81-853b-df179d16e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fcb0e8-589b-4a81-853b-df179d16e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b795541-a0a8-4b83-bc1d-1ae75a1e4f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Volume 744006de-4740-4370-b233-78295b681b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744006de-4740-4370-b233-78295b681b66', 'volume_size': 1} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97" returned: 0 in 0.417s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 is being set with open permissions: ugo+rw Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:14 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 Sep 28 15:23:14 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97" returned: 0 in 0.250s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:14 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.info Sep 28 15:23:14 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:15 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.info" returned: 0 in 0.257s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:15 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.info is being set with open permissions: ugo+rw Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.info Sep 28 15:23:15 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:15 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.info" returned: 0 in 0.271s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279822028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744006de-4740-4370-b233-78295b681b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:14Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Creating volume 744006de-4740-4370-b233-78295b681b66 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:15 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 1073741824 Sep 28 15:23:15 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:15 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-56a556d4-b527-442c-8993-4541874bda24 tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:23:15 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 1073741824" returned: 0 in 0.496s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:15 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 Sep 28 15:23:15 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:16 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66" returned: 0 in 0.290s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b795541-a0a8-4b83-bc1d-1ae75a1e4f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744006de-4740-4370-b233-78295b681b66', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0d00ef-6080-4652-9ebe-17f4fba41707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:16 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Volume volume-744006de-4740-4370-b233-78295b681b66 (744006de-4740-4370-b233-78295b681b66): created successfully Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0d00ef-6080-4652-9ebe-17f4fba41707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (1f846864-4b9c-4d03-be8a-211dc5bbc1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-0e4bd619-dced-4483-bc4a-e4563cf0be97-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a2fb1520-f7fc-43f7-9728-46cb7077567d tempest-ProjectReaderTests-2027499807 None] Created volume successfully. Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Lock "cinder-0e4bd619-dced-4483-bc4a-e4563cf0be97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-f7ddd8ae-7d43-4841-b08c-052e1ff61921" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-f7ddd8ae-7d43-4841-b08c-052e1ff61921" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-0e4bd619-dced-4483-bc4a-e4563cf0be97" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-0e4bd619-dced-4483-bc4a-e4563cf0be97" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 0e4bd619-dced-4483-bc4a-e4563cf0be97 of volume f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd5ab9-bf96-4ad2-a5d9-4f5241b94531]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 Sep 28 15:23:16 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Creating offline snapshot 2773ae31-ee28-4d29-922d-76f409300e82 of volume 744006de-4740-4370-b233-78295b681b66 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3beca3-d9ca-481f-8033-1957c2926c6e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97" returned: 0 in 0.442s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:16 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 Sep 28 15:23:16 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a4b83c-e240-4dfb-9776-18544d8cfe4f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:16 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 Sep 28 15:23:16 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66" returned: 0 in 0.367s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 1G Sep 28 15:23:17 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921" returned: 0 in 0.382s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 Sep 28 15:23:17 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 1G" returned: 0 in 0.499s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-744006de-4740-4370-b233-78295b681b66 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-744006de-4740-4370-b233-78295b681b66 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 Sep 28 15:23:17 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97" returned: 0 in 0.459s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97 Sep 28 15:23:17 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-744006de-4740-4370-b233-78295b681b66 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82" returned: 0 in 0.372s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 is being set with open permissions: ugo+rw Sep 28 15:23:17 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921.0e4bd619-dced-4483-bc4a-e4563cf0be97" returned: 0 in 0.318s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 Sep 28 15:23:18 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-0e4bd619-dced-4483-bc4a-e4563cf0be97" released by "_delete_snapshot" :: held 1.724s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-f7ddd8ae-7d43-4841-b08c-052e1ff61921" released by "delete_snapshot" :: held 1.754s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Created reservations ['17a242da-f230-4588-875e-8d08e932bfe0', 'd11abad8-67fb-4037-9e7f-f65494243a9c', '03f6cd8f-7303-4351-a048-abf9e2171371', '75fa1e3a-4651-4834-99f3-fc13ff50e8fe'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:18 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-9e778db4-91ff-4299-9635-5a49b3d1ab5e tempest-ProjectMemberTests-1666069766 None] Lock "cinder-0e4bd619-dced-4483-bc4a-e4563cf0be97-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:18 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82" returned: 0 in 0.288s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.info Sep 28 15:23:18 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-f7ddd8ae-7d43-4841-b08c-052e1ff61921-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-f7ddd8ae-7d43-4841-b08c-052e1ff61921-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-f7ddd8ae-7d43-4841-b08c-052e1ff61921" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-f7ddd8ae-7d43-4841-b08c-052e1ff61921" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b72977-6440-42e2-8464-dc050a2e8b89]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.info" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.info is being set with open permissions: ugo+rw Sep 28 15:23:18 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.info Sep 28 15:23:18 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 Sep 28 15:23:18 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.info" returned: 0 in 0.306s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:19 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921" returned: 0 in 0.380s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:19 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921 Sep 28 15:23:19 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-430f33f8-9c91-4dc8-9f13-2ef3dd9c81c9 tempest-ProjectReaderTests-2027499807 None] Create snapshot completed successfully Sep 28 15:23:19 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-f7ddd8ae-7d43-4841-b08c-052e1ff61921" returned: 0 in 0.269s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-f7ddd8ae-7d43-4841-b08c-052e1ff61921" released by "delete_volume" :: held 0.727s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Created reservations ['7f85c326-c946-43a3-8800-f5f934ce12be', '83607269-2970-4b5f-8f4c-e4997e25ea19', '517f29cf-edaf-434c-aad0-fa2abc34f40b', '471e4a17-adad-459a-a9b3-88f0406ed401'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:19 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:19 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.335s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:19 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:23:19 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-09dd6bc6-38d8-47a1-9718-f369b4fa1fa4 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-f7ddd8ae-7d43-4841-b08c-052e1ff61921-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-2773ae31-ee28-4d29-922d-76f409300e82-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-2773ae31-ee28-4d29-922d-76f409300e82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-744006de-4740-4370-b233-78295b681b66" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-744006de-4740-4370-b233-78295b681b66" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-2773ae31-ee28-4d29-922d-76f409300e82" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-2773ae31-ee28-4d29-922d-76f409300e82" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Deleting offline snapshot 2773ae31-ee28-4d29-922d-76f409300e82 of volume 744006de-4740-4370-b233-78295b681b66 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] snapshot_file for this snap is: volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f6ed7e-5921-4f96-888f-cc4464697fe1]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (67a0ca55-e434-484a-9096-857538d57fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca32f53a-0b22-4f8e-a1d4-c020dc9384e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca32f53a-0b22-4f8e-a1d4-c020dc9384e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330574964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2234aa0-6a15-4002-a88d-b31f402c0c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:20Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4ee87d-30c3-4155-b4c7-e1428334187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4ee87d-30c3-4155-b4c7-e1428334187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 Sep 28 15:23:20 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcd6994-99f7-44f4-b3d4-0a3b18c5ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcd6994-99f7-44f4-b3d4-0a3b18c5ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2234aa0-6a15-4002-a88d-b31f402c0c6f', 'volume_name': 'volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86291978-a000-403c-a2f5-2b9328398782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86291978-a000-403c-a2f5-2b9328398782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c5c7f3-b57d-47a4-91d7-6abe87764ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:20 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Volume a2234aa0-6a15-4002-a88d-b31f402c0c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f', 'volume_size': 1} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330574964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2234aa0-6a15-4002-a88d-b31f402c0c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:20Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Creating volume a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:20 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f 1073741824 Sep 28 15:23:20 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-744006de-4740-4370-b233-78295b681b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30cc7f8-1c33-4e5b-a954-832717fcf934]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 Sep 28 15:23:20 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f 1073741824" returned: 0 in 0.513s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:20 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f Sep 28 15:23:20 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66" returned: 0 in 0.403s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 Sep 28 15:23:21 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f" returned: 0 in 0.295s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c5c7f3-b57d-47a4-91d7-6abe87764ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbe43f8-ebb5-4604-bcff-bf834be22439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:21 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Volume volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f (a2234aa0-6a15-4002-a88d-b31f402c0c6f): created successfully Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbe43f8-ebb5-4604-bcff-bf834be22439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (67a0ca55-e434-484a-9096-857538d57fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-1b7fe6d6-eb39-4255-a6a3-7719da5a5be4 tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:23:21 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82" returned: 0 in 0.370s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82 Sep 28 15:23:21 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66.2773ae31-ee28-4d29-922d-76f409300e82" returned: 0 in 0.266s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-2773ae31-ee28-4d29-922d-76f409300e82" released by "_delete_snapshot" :: held 1.625s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-744006de-4740-4370-b233-78295b681b66" released by "delete_snapshot" :: held 1.665s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Created reservations ['0999d35d-7aab-4a0c-b7e9-a0edb1ccc63b', '64e95bf8-22e3-4766-a98e-909a24114385', '193bcb44-80f1-48bd-a6f5-2f0217509498', 'b3d524c6-58fb-45db-9a31-86bc45cdcb37'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:21 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Delete snapshot completed successfully. Sep 28 15:23:21 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-08b48f93-bcd5-4be7-b63b-5d27783f8382 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-2773ae31-ee28-4d29-922d-76f409300e82-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-744006de-4740-4370-b233-78295b681b66-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-744006de-4740-4370-b233-78295b681b66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-744006de-4740-4370-b233-78295b681b66" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-744006de-4740-4370-b233-78295b681b66" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a82ee8b-9db9-48a7-8411-8e4554a8726a]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 05faf93f-82a2-4648-b9f2-ab009b5ce34d of volume a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:22 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 Sep 28 15:23:22 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e6cbc-801c-4b52-81dc-28da80b06eb7]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f Sep 28 15:23:22 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:22 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66" returned: 0 in 0.420s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:22 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66 Sep 28 15:23:22 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f" returned: 0 in 0.469s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d 1G Sep 28 15:23:23 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-744006de-4740-4370-b233-78295b681b66" returned: 0 in 0.299s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-744006de-4740-4370-b233-78295b681b66" released by "delete_volume" :: held 0.813s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Created reservations ['c0a12b65-bd8d-4cd9-87a9-d7e7fb4c1142', '8e210abf-7866-4527-84b7-dab838099122', 'c9532fda-2a5d-4535-a6e3-dd1da913bae5', '58036962-6de3-4e6f-ac68-6c14f69a131e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:23 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d 1G" returned: 0 in 0.549s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d Sep 28 15:23:23 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.327s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:23 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Deleted volume successfully. Sep 28 15:23:23 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8d1ea6f1-17a9-42a1-a2f2-fdfabbda4357 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-744006de-4740-4370-b233-78295b681b66-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:24 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d" returned: 0 in 0.384s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d is being set with open permissions: ugo+rw Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d Sep 28 15:23:24 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (b525f654-5f24-4216-a6a9-c24e845e940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3677dc9-22da-444c-9f24-19ca89820fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3677dc9-22da-444c-9f24-19ca89820fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915070359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21383ef-aec3-4a2c-ac1a-9be2e3dca74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:24Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f32fd0-651d-4716-8b53-0e82212fd409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f32fd0-651d-4716-8b53-0e82212fd409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6c69a5-08be-4725-bac8-668e3fad0fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6c69a5-08be-4725-bac8-668e3fad0fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21383ef-aec3-4a2c-ac1a-9be2e3dca74d', 'volume_name': 'volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eddfa93-70d2-4057-bc9d-e21c95eb1d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eddfa93-70d2-4057-bc9d-e21c95eb1d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a827ccd-f9d4-4e99-878f-8b718b9a0aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Volume d21383ef-aec3-4a2c-ac1a-9be2e3dca74d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d', 'volume_size': 1} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:24 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d" returned: 0 in 0.260s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.info Sep 28 15:23:24 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.info" returned: 0 in 0.291s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.info is being set with open permissions: ugo+rw Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.info Sep 28 15:23:24 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.info" returned: 0 in 0.255s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915070359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21383ef-aec3-4a2c-ac1a-9be2e3dca74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:24Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Creating volume d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:24 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:24 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d 1073741824 Sep 28 15:23:24 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3e3c2de7-fdbb-42d1-92fc-b4e9bf524702 tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:23:25 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d 1073741824" returned: 0 in 0.479s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:25 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d Sep 28 15:23:25 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:25 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" returned: 0 in 0.278s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a827ccd-f9d4-4e99-878f-8b718b9a0aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d7cec8-646f-44f5-aca8-f08e4aa21b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:25 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Volume volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d (d21383ef-aec3-4a2c-ac1a-9be2e3dca74d): created successfully Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d7cec8-646f-44f5-aca8-f08e4aa21b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (b525f654-5f24-4216-a6a9-c24e845e940c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:25 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-abb4dcc3-6526-49f8-8841-14ab4d44fae4 tempest-ProjectReaderTests-2027499807 None] Created volume successfully. Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-05faf93f-82a2-4648-b9f2-ab009b5ce34d-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-05faf93f-82a2-4648-b9f2-ab009b5ce34d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-a2234aa0-6a15-4002-a88d-b31f402c0c6f" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-a2234aa0-6a15-4002-a88d-b31f402c0c6f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-05faf93f-82a2-4648-b9f2-ab009b5ce34d" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-05faf93f-82a2-4648-b9f2-ab009b5ce34d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 05faf93f-82a2-4648-b9f2-ab009b5ce34d of volume a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f223853-578d-4520-8ed2-3ce8e4d5f080]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:25 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:25 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d Sep 28 15:23:25 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d" returned: 0 in 0.465s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab23496-2984-4cb4-856b-ed0f1932ee64]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Creating offline snapshot e5b5a637-f999-4501-9790-a2fc6e0071d7 of volume d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[1079f9b2-3b31-4b23-967f-3c90872a82b4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f Sep 28 15:23:26 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d Sep 28 15:23:26 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f" returned: 0 in 0.492s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d Sep 28 15:23:26 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:26 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" returned: 0 in 0.450s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:26 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:26 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 1G Sep 28 15:23:26 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d" returned: 0 in 0.384s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:27 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d Sep 28 15:23:27 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 1G" returned: 0 in 0.509s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:27 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 Sep 28 15:23:27 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f.05faf93f-82a2-4648-b9f2-ab009b5ce34d" returned: 0 in 0.300s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-05faf93f-82a2-4648-b9f2-ab009b5ce34d" released by "_delete_snapshot" :: held 1.780s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-a2234aa0-6a15-4002-a88d-b31f402c0c6f" released by "delete_snapshot" :: held 1.812s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Created reservations ['76e771be-a23a-44fe-9243-a3cae130145b', '41a80eea-98b9-4e36-8317-ddbae3bb1977', '6fca99dc-190a-45e7-965a-61d1db3f33d9', '40de119b-579e-4550-a26f-fd373e6e0daa'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:27 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a6887ded-aaeb-4db4-8654-1566cf2b6ba5 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-05faf93f-82a2-4648-b9f2-ab009b5ce34d-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:27 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7" returned: 0 in 0.364s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:27 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 is being set with open permissions: ugo+rw Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:27 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 Sep 28 15:23:27 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-a2234aa0-6a15-4002-a88d-b31f402c0c6f-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:27 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-a2234aa0-6a15-4002-a88d-b31f402c0c6f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-a2234aa0-6a15-4002-a88d-b31f402c0c6f" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-a2234aa0-6a15-4002-a88d-b31f402c0c6f" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d5cd68-4839-4059-81c7-7b8abd8349f3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7" returned: 0 in 0.340s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.info Sep 28 15:23:28 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f Sep 28 15:23:28 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.info" returned: 0 in 0.328s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.info is being set with open permissions: ugo+rw Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.info Sep 28 15:23:28 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f" returned: 0 in 0.436s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:28 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f Sep 28 15:23:28 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:28 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.info" returned: 0 in 0.308s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:28 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e0ec5905-b2da-4413-892c-64fea410287d tempest-ProjectReaderTests-2027499807 None] Create snapshot completed successfully Sep 28 15:23:28 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-a2234aa0-6a15-4002-a88d-b31f402c0c6f" returned: 0 in 0.378s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:28 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-a2234aa0-6a15-4002-a88d-b31f402c0c6f" released by "delete_volume" :: held 0.897s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Created reservations ['77ebde3b-8321-49e0-99b2-3c433a737ad6', '4a17f056-3c40-47e4-af00-a5f0c8ae40fd', 'ae4f50d9-1745-4c4b-94f2-24f06891af8c', 'ff2d88e7-ff0e-4d1d-b01a-8a8cf071eab1'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:29 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:29 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:29 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.260s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:29 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0f77d52d-79b3-4af1-8c14-b2851d3cd970 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-a2234aa0-6a15-4002-a88d-b31f402c0c6f-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-e5b5a637-f999-4501-9790-a2fc6e0071d7-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-e5b5a637-f999-4501-9790-a2fc6e0071d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-e5b5a637-f999-4501-9790-a2fc6e0071d7" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (dba1049c-f37c-4646-b9e9-97597ec6b617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27264f00-3cc3-41af-830d-786a588e1554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-e5b5a637-f999-4501-9790-a2fc6e0071d7" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Deleting offline snapshot e5b5a637-f999-4501-9790-a2fc6e0071d7 of volume d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] snapshot_file for this snap is: volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27264f00-3cc3-41af-830d-786a588e1554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-936800450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fd783a-553f-4fa3-afd7-2c6a384d0341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:30Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bddf40-53ee-4f4e-a09b-cc21e3ef0c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bddf40-53ee-4f4e-a09b-cc21e3ef0c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da02076-10e3-402b-bf8e-d9e610c13dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da02076-10e3-402b-bf8e-d9e610c13dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fd783a-553f-4fa3-afd7-2c6a384d0341', 'volume_name': 'volume-75fd783a-553f-4fa3-afd7-2c6a384d0341', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578611e9-aa35-48e9-b81c-c1645bdab3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578611e9-aa35-48e9-b81c-c1645bdab3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc66273-bec9-4651-b31b-02397db64452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Volume 75fd783a-553f-4fa3-afd7-2c6a384d0341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fd783a-553f-4fa3-afd7-2c6a384d0341', 'volume_size': 1} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-936800450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fd783a-553f-4fa3-afd7-2c6a384d0341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:30Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Creating volume 75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:29 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a56d18e-d562-4867-81e1-2333ed645741]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:29 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:29 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 1073741824 Sep 28 15:23:29 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:29 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 Sep 28 15:23:29 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7" returned: 0 in 0.389s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:30 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 1073741824" returned: 0 in 0.433s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db29617-ff8f-480e-a3f9-f5f316f51151]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:30 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 Sep 28 15:23:30 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d Sep 28 15:23:30 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341" returned: 0 in 0.319s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc66273-bec9-4651-b31b-02397db64452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fd783a-553f-4fa3-afd7-2c6a384d0341', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8edf22-e64b-43ba-96d8-16433df61ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:30 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Volume volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 (75fd783a-553f-4fa3-afd7-2c6a384d0341): created successfully Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8edf22-e64b-43ba-96d8-16433df61ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (dba1049c-f37c-4646-b9e9-97597ec6b617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:30 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" returned: 0 in 0.451s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:30 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b7a47de4-0f81-4a81-9519-d81b2511b269 tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:23:30 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 Sep 28 15:23:30 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:31 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7" returned: 0 in 0.351s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:31 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7 Sep 28 15:23:31 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:31 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d.e5b5a637-f999-4501-9790-a2fc6e0071d7" returned: 0 in 0.251s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-e5b5a637-f999-4501-9790-a2fc6e0071d7" released by "_delete_snapshot" :: held 1.599s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" released by "delete_snapshot" :: held 1.651s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Created reservations ['15f4013e-36c2-40d5-b0a9-9470625cbfad', '8d17055b-090a-4073-b215-4e4fa6a9f1f3', 'fca69305-4f42-4e34-92ec-6f17f0c9d0e7', '24c16ea8-59c0-4d6b-a54f-198201aeabb6'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:31 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Delete snapshot completed successfully. Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-64f44290-8467-4943-bbf6-3df49c769da7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-e5b5a637-f999-4501-9790-a2fc6e0071d7-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Lock "cinder-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a4956-6064-4d73-a362-7431b65d599b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 640aa2bf-7ede-4e72-b2f7-ce55243527ae of volume 75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1db9e93-2c31-493c-a1da-2070aff25fae]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:31 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 Sep 28 15:23:32 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d Sep 28 15:23:32 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341" returned: 0 in 0.377s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" returned: 0 in 0.454s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae 1G Sep 28 15:23:32 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d Sep 28 15:23:32 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" returned: 0 in 0.304s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d" released by "delete_volume" :: held 0.844s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Created reservations ['c361c1b0-066b-4ddc-8a00-d6fe281c3a18', 'a8af394e-df18-4965-8e60-07cf0072da2c', '68daac7e-0856-496c-a509-0daca9a51c92', '51025991-e0c8-459f-8d4b-cffe9dd7c21e'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:32 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae 1G" returned: 0 in 0.496s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:32 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae Sep 28 15:23:32 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:32 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.296s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:33 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae" returned: 0 in 0.337s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae is being set with open permissions: ugo+rw Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Deleted volume successfully. Sep 28 15:23:33 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae Sep 28 15:23:33 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-f9ce858a-2e85-4d46-b881-36aca249da9d tempest-ProjectReaderTests-2027499807 None] Lock "cinder-d21383ef-aec3-4a2c-ac1a-9be2e3dca74d-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:33 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae" returned: 0 in 0.320s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (f3be02b5-5536-4991-ab8e-bfe570487144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfc94fd-75cc-4695-a464-6988136d474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfc94fd-75cc-4695-a464-6988136d474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838234699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08db0c50-4dbc-4398-9df4-c34dd0d90088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:34Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c7e273-199e-4b1c-8b74-c0c9d8f901cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.info Sep 28 15:23:33 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c7e273-199e-4b1c-8b74-c0c9d8f901cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff18bcf-bdce-42af-a1e7-5357b2340736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff18bcf-bdce-42af-a1e7-5357b2340736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08db0c50-4dbc-4398-9df4-c34dd0d90088', 'volume_name': 'volume-08db0c50-4dbc-4398-9df4-c34dd0d90088', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db212141-c5bf-468a-b683-7598c8df6f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db212141-c5bf-468a-b683-7598c8df6f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6341da-a84f-4a98-a9f7-e2be2d9498ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Volume 08db0c50-4dbc-4398-9df4-c34dd0d90088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08db0c50-4dbc-4398-9df4-c34dd0d90088', 'volume_size': 1} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.info" returned: 0 in 0.262s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.info is being set with open permissions: ugo+rw Sep 28 15:23:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:33 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.info Sep 28 15:23:33 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.304s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:23:34 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.info" returned: 0 in 0.302s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838234699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08db0c50-4dbc-4398-9df4-c34dd0d90088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:34Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Creating volume 08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:34 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 1073741824 Sep 28 15:23:34 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-2a68de48-0b4a-493a-8b9c-1d7e3960469b tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:23:34 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 1073741824" returned: 0 in 0.483s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 Sep 28 15:23:34 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088" returned: 0 in 0.250s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6341da-a84f-4a98-a9f7-e2be2d9498ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08db0c50-4dbc-4398-9df4-c34dd0d90088', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e292304-b241-409f-9b66-4505c896c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:35 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Volume volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 (08db0c50-4dbc-4398-9df4-c34dd0d90088): created successfully Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e292304-b241-409f-9b66-4505c896c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (f3be02b5-5536-4991-ab8e-bfe570487144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:35 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-3bf2d06e-ad90-4c54-92ca-7760291ac010 tempest-ProjectReaderTests-2027499807 None] Created volume successfully. Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-640aa2bf-7ede-4e72-b2f7-ce55243527ae-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-640aa2bf-7ede-4e72-b2f7-ce55243527ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-75fd783a-553f-4fa3-afd7-2c6a384d0341" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-75fd783a-553f-4fa3-afd7-2c6a384d0341" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-640aa2bf-7ede-4e72-b2f7-ce55243527ae" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-640aa2bf-7ede-4e72-b2f7-ce55243527ae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 640aa2bf-7ede-4e72-b2f7-ce55243527ae of volume 75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8dc97-8669-43c3-a429-5e87a5811f0b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae Sep 28 15:23:35 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae" returned: 0 in 0.405s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75fd783a-553f-4fa3-afd7-2c6a384d0341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1f5214-cd87-4372-ae4d-46af543110c5]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 Sep 28 15:23:35 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Creating offline snapshot 32394367-3a5b-4489-a24f-040ee97bb007 of volume 08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[83902ad8-fe2b-4dc7-9a47-173733f29c6d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 Sep 28 15:23:35 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341" returned: 0 in 0.392s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae Sep 28 15:23:36 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088" returned: 0 in 0.385s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 1G Sep 28 15:23:36 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae" returned: 0 in 0.346s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae Sep 28 15:23:36 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341.640aa2bf-7ede-4e72-b2f7-ce55243527ae" returned: 0 in 0.292s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 1G" returned: 0 in 0.452s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-640aa2bf-7ede-4e72-b2f7-ce55243527ae" released by "_delete_snapshot" :: held 1.563s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-75fd783a-553f-4fa3-afd7-2c6a384d0341" released by "delete_snapshot" :: held 1.593s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:36 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 Sep 28 15:23:36 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Created reservations ['bf5c3913-549c-46e3-8eb5-718418a9bc15', '4e6a86c7-bf42-4ed2-99c9-f3fbb36afdef', '31fbab4e-b874-433d-aa03-94b53ddd92a1', '8269aaef-9f43-4c41-842d-3019db95cdae'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:36 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:23:36 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-15b2dbe5-db91-415d-8b91-bab045c32918 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-640aa2bf-7ede-4e72-b2f7-ce55243527ae-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007" returned: 0 in 0.320s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 is being set with open permissions: ugo+rw Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 Sep 28 15:23:37 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-75fd783a-553f-4fa3-afd7-2c6a384d0341-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:37 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007" returned: 0 in 0.268s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-75fd783a-553f-4fa3-afd7-2c6a384d0341-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.info Sep 28 15:23:37 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-75fd783a-553f-4fa3-afd7-2c6a384d0341" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-75fd783a-553f-4fa3-afd7-2c6a384d0341" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca6d5c-4663-4641-aad2-54e8eff7850e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 Sep 28 15:23:37 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.info" returned: 0 in 0.274s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.info is being set with open permissions: ugo+rw Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.info Sep 28 15:23:37 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341" returned: 0 in 0.388s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341 Sep 28 15:23:37 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.info" returned: 0 in 0.260s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:37 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-acaec9ac-76cd-4867-888c-dfc9989de306 tempest-ProjectReaderTests-2027499807 None] Create snapshot completed successfully Sep 28 15:23:38 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-75fd783a-553f-4fa3-afd7-2c6a384d0341" returned: 0 in 0.261s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-75fd783a-553f-4fa3-afd7-2c6a384d0341" released by "delete_volume" :: held 0.724s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Created reservations ['511a7630-39e2-4c85-b2d4-7d227456d351', '35f9bcfc-4b98-44e2-bf95-1ae7aaa92b47', 'ce70501f-f7ea-430e-8393-97c4f77d5ee7', 'e5f51d2c-697c-4b54-a181-930ca589bfc0'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:38 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.278s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:38 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-d1e704e1-9bab-4fca-84f4-26316c44a907 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-75fd783a-553f-4fa3-afd7-2c6a384d0341-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:38 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (7acbe802-7703-43f1-94ac-3c57924471b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b74532-bf2a-4b72-820b-949a44a124fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-32394367-3a5b-4489-a24f-040ee97bb007-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b74532-bf2a-4b72-820b-949a44a124fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972091885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716eac46-58c9-4626-9270-f4f1c9eafa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:39Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6820ea12-9e2c-466d-9285-39e18a882dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6820ea12-9e2c-466d-9285-39e18a882dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f66b72-454c-4b34-b320-d0c43eeed110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f66b72-454c-4b34-b320-d0c43eeed110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716eac46-58c9-4626-9270-f4f1c9eafa86', 'volume_name': 'volume-716eac46-58c9-4626-9270-f4f1c9eafa86', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be13c942-09e3-49ab-a1c3-8993c7b9acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be13c942-09e3-49ab-a1c3-8993c7b9acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57c5583-df39-42d7-950a-af3a3ba80dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Volume 716eac46-58c9-4626-9270-f4f1c9eafa86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716eac46-58c9-4626-9270-f4f1c9eafa86', 'volume_size': 1} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972091885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716eac46-58c9-4626-9270-f4f1c9eafa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:39Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Creating volume 716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-32394367-3a5b-4489-a24f-040ee97bb007-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-08db0c50-4dbc-4398-9df4-c34dd0d90088" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:39 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 1073741824 Sep 28 15:23:39 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-08db0c50-4dbc-4398-9df4-c34dd0d90088" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-32394367-3a5b-4489-a24f-040ee97bb007" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-32394367-3a5b-4489-a24f-040ee97bb007" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Deleting offline snapshot 32394367-3a5b-4489-a24f-040ee97bb007 of volume 08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] snapshot_file for this snap is: volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9620495-a6d9-4e58-bab8-e3d9cf969c2d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 Sep 28 15:23:39 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 1073741824" returned: 0 in 0.456s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007" returned: 0 in 0.382s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08db0c50-4dbc-4398-9df4-c34dd0d90088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab03a1d-4953-49ea-9698-dbb52fb1047b]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 Sep 28 15:23:39 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 Sep 28 15:23:39 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86" returned: 0 in 0.260s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57c5583-df39-42d7-950a-af3a3ba80dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716eac46-58c9-4626-9270-f4f1c9eafa86', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5a9bd7-1ad7-44ef-b7a2-f6332e7e0467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Volume volume-716eac46-58c9-4626-9270-f4f1c9eafa86 (716eac46-58c9-4626-9270-f4f1c9eafa86): created successfully Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5a9bd7-1ad7-44ef-b7a2-f6332e7e0467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (7acbe802-7703-43f1-94ac-3c57924471b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:39 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0df55b9b-8732-47b7-b8a0-9aab3d3f0251 tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:23:40 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088" returned: 0 in 0.398s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 Sep 28 15:23:40 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007" returned: 0 in 0.330s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007 Sep 28 15:23:40 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088.32394367-3a5b-4489-a24f-040ee97bb007" returned: 0 in 0.251s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-32394367-3a5b-4489-a24f-040ee97bb007" released by "_delete_snapshot" :: held 1.483s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-08db0c50-4dbc-4398-9df4-c34dd0d90088" released by "delete_snapshot" :: held 1.505s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Created reservations ['b20f84d4-a97c-4845-b820-65d2c6f9a697', '66ed636e-cafd-4c93-a84b-0dd8f50a1eff', '28668654-a391-4eb8-bb55-d61ec4efc6ed', '4b525cea-39c1-4ceb-8f8a-07c884473928'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:40 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Delete snapshot completed successfully. Sep 28 15:23:40 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-6a299ecb-c4f5-4dc4-8a59-28f513bd3441 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-32394367-3a5b-4489-a24f-040ee97bb007-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 0d462a26-98c0-4a71-93c2-4de0f228f523 of volume 716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-08db0c50-4dbc-4398-9df4-c34dd0d90088-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[439158e8-eef7-468c-aed9-9eaae0d342b4]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-08db0c50-4dbc-4398-9df4-c34dd0d90088-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-08db0c50-4dbc-4398-9df4-c34dd0d90088" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-08db0c50-4dbc-4398-9df4-c34dd0d90088" acquired by "delete_volume" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:41 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 Sep 28 15:23:41 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c07bae-a949-4397-bc81-7ccc191b2104]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 Sep 28 15:23:41 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86" returned: 0 in 0.444s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 1G Sep 28 15:23:41 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088" returned: 0 in 0.420s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088 Sep 28 15:23:41 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-08db0c50-4dbc-4398-9df4-c34dd0d90088" returned: 0 in 0.273s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-08db0c50-4dbc-4398-9df4-c34dd0d90088" released by "delete_volume" :: held 0.767s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:42 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 1G" returned: 0 in 0.438s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716eac46-58c9-4626-9270-f4f1c9eafa86 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716eac46-58c9-4626-9270-f4f1c9eafa86 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 Sep 28 15:23:42 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Created reservations ['a27179cb-f79d-44a3-a446-987a9447b8aa', '5a6b587d-bfd3-4cab-a205-cfe57c9eda63', '0240372a-7232-4081-bd19-33b4e61154c6', 'e92fef69-f697-4762-a002-c2e72dcb141c'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:42 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-716eac46-58c9-4626-9270-f4f1c9eafa86 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523" returned: 0 in 0.360s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 is being set with open permissions: ugo+rw Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 Sep 28 15:23:42 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.382s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:42 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Deleted volume successfully. Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-8ad4fc3e-edc0-4794-93e7-6699d78e1083 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-08db0c50-4dbc-4398-9df4-c34dd0d90088-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:42 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523" returned: 0 in 0.334s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.info Sep 28 15:23:42 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (f419a79b-19fe-4163-9cc7-bd2e4aa5214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc9b2f6-f40b-4536-ab91-b25ce965741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc9b2f6-f40b-4536-ab91-b25ce965741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182161288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb2908a-e853-4152-8395-6fd56d996abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:43Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0696192b-2ee4-4e38-a444-9db6041f5dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0696192b-2ee4-4e38-a444-9db6041f5dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ab8c4b-de93-4ca8-a4c5-a182b4436c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ab8c4b-de93-4ca8-a4c5-a182b4436c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb2908a-e853-4152-8395-6fd56d996abe', 'volume_name': 'volume-5bb2908a-e853-4152-8395-6fd56d996abe', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba23457-213d-40d5-b835-509e4bfcc821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba23457-213d-40d5-b835-509e4bfcc821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7807b0-7e48-4aac-b4cd-b480ff90bdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:43 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Volume 5bb2908a-e853-4152-8395-6fd56d996abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb2908a-e853-4152-8395-6fd56d996abe', 'volume_size': 1} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.info" returned: 0 in 0.321s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.info is being set with open permissions: ugo+rw Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.info Sep 28 15:23:43 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.info" returned: 0 in 0.255s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182161288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb2908a-e853-4152-8395-6fd56d996abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c738c6d134e768e5bf681dfd1ca3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:43Z,use_quota=True,user_id='95e6e231d7ac4b4a91cf906f79c8ece0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Creating volume 5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:43 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe 1073741824 Sep 28 15:23:43 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-75cc768f-ba93-449a-ba17-1a8c541ba310 tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:23:43 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe 1073741824" returned: 0 in 0.455s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe Sep 28 15:23:43 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:44 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe" returned: 0 in 0.245s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7807b0-7e48-4aac-b4cd-b480ff90bdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb2908a-e853-4152-8395-6fd56d996abe', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6dd1d5-f94c-4431-bf83-9b5f4f2af96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:44 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Volume volume-5bb2908a-e853-4152-8395-6fd56d996abe (5bb2908a-e853-4152-8395-6fd56d996abe): created successfully Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6dd1d5-f94c-4431-bf83-9b5f4f2af96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Flow 'volume_create_manager' (f419a79b-19fe-4163-9cc7-bd2e4aa5214b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:44 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-985c4323-b3cc-4234-86a5-b7fb9758b84c tempest-ProjectReaderTests-2027499807 None] Created volume successfully. Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-0d462a26-98c0-4a71-93c2-4de0f228f523-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-0d462a26-98c0-4a71-93c2-4de0f228f523-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-716eac46-58c9-4626-9270-f4f1c9eafa86" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-716eac46-58c9-4626-9270-f4f1c9eafa86" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-0d462a26-98c0-4a71-93c2-4de0f228f523" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-0d462a26-98c0-4a71-93c2-4de0f228f523" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 0d462a26-98c0-4a71-93c2-4de0f228f523 of volume 716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a84e0f1-7ded-4bef-a8d3-065e93583d9c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:44 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 Sep 28 15:23:44 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:44 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523" returned: 0 in 0.401s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-716eac46-58c9-4626-9270-f4f1c9eafa86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7043dd5-4c81-44c0-b2b5-f1e99ce740e6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 Sep 28 15:23:45 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:45 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86" returned: 0 in 0.456s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Creating offline snapshot 12612905-5b43-4efc-8b08-fcb1a96253ce of volume 5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:45 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 Sep 28 15:23:45 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea6756-4ae5-426a-b787-106a252cb9e6]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe Sep 28 15:23:45 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523" returned: 0 in 0.388s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523 Sep 28 15:23:45 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe" returned: 0 in 0.421s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce 1G Sep 28 15:23:45 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86.0d462a26-98c0-4a71-93c2-4de0f228f523" returned: 0 in 0.259s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-0d462a26-98c0-4a71-93c2-4de0f228f523" released by "_delete_snapshot" :: held 1.631s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-716eac46-58c9-4626-9270-f4f1c9eafa86" released by "delete_snapshot" :: held 1.659s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Created reservations ['b0f3121f-3f83-4f2e-9a6a-7f8f4e15a892', 'cc04355f-0906-4f68-a4f8-8f33c9f3a3cd', 'dbcbbd20-1abd-4ae2-bac5-c8bbb2492ca7', 'a6abfd45-cf9c-467e-b003-62c64e467b4f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:46 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e3ec7e07-43f8-4d7c-a174-9c0d53aab4c7 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-0d462a26-98c0-4a71-93c2-4de0f228f523-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:46 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce 1G" returned: 0 in 0.468s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb2908a-e853-4152-8395-6fd56d996abe -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:46 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb2908a-e853-4152-8395-6fd56d996abe -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce Sep 28 15:23:46 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-716eac46-58c9-4626-9270-f4f1c9eafa86-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-716eac46-58c9-4626-9270-f4f1c9eafa86-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-716eac46-58c9-4626-9270-f4f1c9eafa86" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:46 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb2908a-e853-4152-8395-6fd56d996abe -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce" returned: 0 in 0.349s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce is being set with open permissions: ugo+rw Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-716eac46-58c9-4626-9270-f4f1c9eafa86" acquired by "delete_volume" :: waited 0.030s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:46 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce Sep 28 15:23:46 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf0b517-e7f9-4457-bed1-4e898ea80e63]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:46 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 Sep 28 15:23:46 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce" returned: 0 in 0.274s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.info Sep 28 15:23:47 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86" returned: 0 in 0.422s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86 Sep 28 15:23:47 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.info" returned: 0 in 0.284s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.info is being set with open permissions: ugo+rw Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.info Sep 28 15:23:47 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-716eac46-58c9-4626-9270-f4f1c9eafa86" returned: 0 in 0.303s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-716eac46-58c9-4626-9270-f4f1c9eafa86" released by "delete_volume" :: held 0.815s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:47 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.info" returned: 0 in 0.281s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Created reservations ['9b419cd6-d92c-43a1-8609-13b06bc3a5cb', '5fcf5065-52bf-45d3-9905-88cfd82dfc4b', '561614a1-351b-4371-b5bd-cc38bb3572d5', 'eafacbdf-ce8d-448b-bbe2-d7488f7a2732'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:47 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-d3f1835c-a55f-4ee0-81af-c15fb339f513 tempest-ProjectReaderTests-2027499807 None] Create snapshot completed successfully Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:47 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:47 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.312s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:48 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-c663d969-d084-4eca-b633-4d3aa8c903f6 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-716eac46-58c9-4626-9270-f4f1c9eafa86-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (b1272eef-e8c4-46bb-b522-33fd67a566a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7024c0-53bd-43fa-8e6a-6651c31f6cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7024c0-53bd-43fa-8e6a-6651c31f6cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401401842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3354085-bbf0-474f-95fb-703e335374fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:48Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6713c4a5-dbdc-4d41-be15-30cb0fae7c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6713c4a5-dbdc-4d41-be15-30cb0fae7c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a635421c-c280-4957-ae48-51f38e41997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a635421c-c280-4957-ae48-51f38e41997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3354085-bbf0-474f-95fb-703e335374fb', 'volume_name': 'volume-d3354085-bbf0-474f-95fb-703e335374fb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82042e66-db77-4f52-89ce-5b1298e1cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82042e66-db77-4f52-89ce-5b1298e1cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c816579-e801-442c-a7f6-5372f022e928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:48 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Volume d3354085-bbf0-474f-95fb-703e335374fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3354085-bbf0-474f-95fb-703e335374fb', 'volume_size': 1} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401401842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3354085-bbf0-474f-95fb-703e335374fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:48Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Creating volume d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:48 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:48 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb 1073741824 Sep 28 15:23:48 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-12612905-5b43-4efc-8b08-fcb1a96253ce-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-12612905-5b43-4efc-8b08-fcb1a96253ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-5bb2908a-e853-4152-8395-6fd56d996abe" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-5bb2908a-e853-4152-8395-6fd56d996abe" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-12612905-5b43-4efc-8b08-fcb1a96253ce" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-12612905-5b43-4efc-8b08-fcb1a96253ce" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Deleting offline snapshot 12612905-5b43-4efc-8b08-fcb1a96253ce of volume 5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] snapshot_file for this snap is: volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[7033a07b-6254-40a7-b6e1-df6d04929605]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:48 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:48 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce Sep 28 15:23:48 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb 1073741824" returned: 0 in 0.601s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb Sep 28 15:23:49 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce" returned: 0 in 0.426s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bb2908a-e853-4152-8395-6fd56d996abe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dabc8d3-2b18-41ff-b039-9ccbafd3004c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe Sep 28 15:23:49 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb" returned: 0 in 0.273s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c816579-e801-442c-a7f6-5372f022e928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3354085-bbf0-474f-95fb-703e335374fb', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36a6ed3-cf96-4c0f-8cb6-e0c18cfa2dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:49 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Volume volume-d3354085-bbf0-474f-95fb-703e335374fb (d3354085-bbf0-474f-95fb-703e335374fb): created successfully Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36a6ed3-cf96-4c0f-8cb6-e0c18cfa2dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (b1272eef-e8c4-46bb-b522-33fd67a566a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:49 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-f158202c-b81c-4a78-ad7e-689760e7a2ee tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:23:49 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe" returned: 0 in 0.476s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce Sep 28 15:23:49 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce" returned: 0 in 0.404s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:50 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce Sep 28 15:23:50 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe.12612905-5b43-4efc-8b08-fcb1a96253ce" returned: 0 in 0.319s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-12612905-5b43-4efc-8b08-fcb1a96253ce" released by "_delete_snapshot" :: held 1.813s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-5bb2908a-e853-4152-8395-6fd56d996abe" released by "delete_snapshot" :: held 1.857s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Created reservations ['cd212b71-0ed7-41bf-9074-fdf44d7853c9', '31c94893-afab-4bd7-847b-249993af085f', '8249b643-26fa-4909-aa98-ccf648e046ab', 'e69d16c5-baf0-441b-8978-6db19ba5f525'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 778e5f64-fad0-4d6b-9bca-3729c04b594f of volume d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b30f31-52ac-40a0-ac33-9922c621a372]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:50 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Delete snapshot completed successfully. Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-24e2b5f4-e454-4f4a-b220-b0c068a8ebb7 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-12612905-5b43-4efc-8b08-fcb1a96253ce-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-5bb2908a-e853-4152-8395-6fd56d996abe-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-5bb2908a-e853-4152-8395-6fd56d996abe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:50 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb Sep 28 15:23:50 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "cinder-quobyte-5bb2908a-e853-4152-8395-6fd56d996abe" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-5bb2908a-e853-4152-8395-6fd56d996abe" acquired by "delete_volume" :: waited 0.021s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a848fc1b-d58b-4c61-bf6c-2cf4b000ee63]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:50 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe Sep 28 15:23:51 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb" returned: 0 in 0.504s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f 1G Sep 28 15:23:51 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe" returned: 0 in 0.429s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe Sep 28 15:23:51 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f 1G" returned: 0 in 0.502s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3354085-bbf0-474f-95fb-703e335374fb -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3354085-bbf0-474f-95fb-703e335374fb -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f Sep 28 15:23:51 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-5bb2908a-e853-4152-8395-6fd56d996abe" returned: 0 in 0.325s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-quobyte-5bb2908a-e853-4152-8395-6fd56d996abe" released by "delete_volume" :: held 0.851s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Created reservations ['dee17507-8fbe-41fc-ac33-57a39edb00af', '204d1e3d-8619-4f6a-b912-fa5b123f2d24', 'cabed976-a0e3-48cb-88df-7004b0d8ab29', 'd91828df-0d07-4767-8da5-1b524bf9328f'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:51 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:52 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3354085-bbf0-474f-95fb-703e335374fb -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f" returned: 0 in 0.353s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f is being set with open permissions: ugo+rw Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f Sep 28 15:23:52 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:52 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.315s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:52 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Deleted volume successfully. Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-acec466a-709e-4618-aa1a-c26e756209e9 tempest-ProjectReaderTests-2027499807 None] Lock "cinder-5bb2908a-e853-4152-8395-6fd56d996abe-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:52 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f" returned: 0 in 0.306s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.info Sep 28 15:23:52 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:52 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.info" returned: 0 in 0.317s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.info is being set with open permissions: ugo+rw Sep 28 15:23:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.info Sep 28 15:23:52 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:53 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.info" returned: 0 in 0.318s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:53 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-6c337285-5ea4-4648-b523-e71274855623 tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-778e5f64-fad0-4d6b-9bca-3729c04b594f-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-778e5f64-fad0-4d6b-9bca-3729c04b594f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-d3354085-bbf0-474f-95fb-703e335374fb" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-d3354085-bbf0-474f-95fb-703e335374fb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-778e5f64-fad0-4d6b-9bca-3729c04b594f" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-778e5f64-fad0-4d6b-9bca-3729c04b594f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 778e5f64-fad0-4d6b-9bca-3729c04b594f of volume d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[24143f4f-6319-4625-ab88-9d20b9b712f2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f Sep 28 15:23:54 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f" returned: 0 in 0.382s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3354085-bbf0-474f-95fb-703e335374fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada5bada-d690-40cd-b483-f00d1eaa88a2]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb Sep 28 15:23:54 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb" returned: 0 in 0.399s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f Sep 28 15:23:54 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:55 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f" returned: 0 in 0.376s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f Sep 28 15:23:55 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:55 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb.778e5f64-fad0-4d6b-9bca-3729c04b594f" returned: 0 in 0.262s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-778e5f64-fad0-4d6b-9bca-3729c04b594f" released by "_delete_snapshot" :: held 1.556s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-d3354085-bbf0-474f-95fb-703e335374fb" released by "delete_snapshot" :: held 1.584s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=174,cinder:INSERT=68,cinder:UPDATE=221,cinder:DELETE=20 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=224,cinder:SELECT=177,cinder:DELETE=18,cinder:INSERT=61 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Created reservations ['96b39617-c929-441b-8167-158908508c5c', '10277272-cbb4-4952-a70f-44589077beec', '612b434f-cc5c-4c18-aa37-b2a49c32358a', '3acc39df-6227-4293-a662-b19101959c0d'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:23:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-16b0525a-90de-4688-b74d-629fe02d095d tempest-ProjectMemberTests-1666069766 None] Lock "cinder-778e5f64-fad0-4d6b-9bca-3729c04b594f-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-d3354085-bbf0-474f-95fb-703e335374fb-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Lock "cinder-d3354085-bbf0-474f-95fb-703e335374fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-d3354085-bbf0-474f-95fb-703e335374fb" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-d3354085-bbf0-474f-95fb-703e335374fb" acquired by "delete_volume" :: waited 0.026s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd904636-4f07-4458-afd7-d3f7a18450af]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb Sep 28 15:23:56 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb" returned: 0 in 0.462s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb Sep 28 15:23:56 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-d3354085-bbf0-474f-95fb-703e335374fb" returned: 0 in 0.253s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-d3354085-bbf0-474f-95fb-703e335374fb" released by "delete_volume" :: held 0.817s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Created reservations ['05a139d1-908f-4813-a7ed-41812e02405e', 'd092f803-419b-4f72-8391-67873c4a0dc0', '77071ef5-db26-4774-b8b1-1e7035564f5c', 'fdcd0ec3-6b9b-499f-a085-f3c4c0a99652'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:57 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:23:57 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.258s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:57 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-b3201b1a-282b-458a-9fcd-631f3039ba1b tempest-ProjectMemberTests-1666069766 None] Lock "cinder-d3354085-bbf0-474f-95fb-703e335374fb-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (4be6f7d1-38af-4122-9062-581e4dea5f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6cab94-4c33-4607-97cc-52f31cf35387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6cab94-4c33-4607-97cc-52f31cf35387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128304121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffe6e9a-06c4-4793-b89f-d4a0a539ef07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:58Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4808cdf4-461b-4461-89d1-252a19966bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4808cdf4-461b-4461-89d1-252a19966bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3724742c-f9f6-4110-9267-ed4835b5de8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3724742c-f9f6-4110-9267-ed4835b5de8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fffe6e9a-06c4-4793-b89f-d4a0a539ef07', 'volume_name': 'volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac2abaf-9c94-4173-a13f-24c4daf7af1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac2abaf-9c94-4173-a13f-24c4daf7af1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f056b-576b-4a4f-acac-f9b50a8db1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:57 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Volume fffe6e9a-06c4-4793-b89f-d4a0a539ef07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07', 'volume_size': 1} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128304121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffe6e9a-06c4-4793-b89f-d4a0a539ef07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9cecb28ad64fe38ea16d1d25100dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:58Z,use_quota=True,user_id='65ebec9d10a949a1a0dbed4f869e75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Creating volume fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:57 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:23:57 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:57 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 1073741824 Sep 28 15:23:57 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:58 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 1073741824" returned: 0 in 0.456s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:58 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 Sep 28 15:23:58 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:58 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" returned: 0 in 0.292s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f056b-576b-4a4f-acac-f9b50a8db1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7d830e-9cd7-44d3-931a-4a154b47bb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:58 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Volume volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 (fffe6e9a-06c4-4793-b89f-d4a0a539ef07): created successfully Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7d830e-9cd7-44d3-931a-4a154b47bb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:58 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Flow 'volume_create_manager' (4be6f7d1-38af-4122-9062-581e4dea5f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:58 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-59a3a878-5538-49c5-bbb5-ba0865cd7e86 tempest-ProjectMemberTests-1666069766 None] Created volume successfully. Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Creating offline snapshot 22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 of volume fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c73b1-396f-4d96-afec-e82bbb668e1c]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 Sep 28 15:24:00 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" returned: 0 in 0.448s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 1G Sep 28 15:24:00 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 1G" returned: 0 in 0.447s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 Sep 28 15:24:00 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" returned: 0 in 0.346s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 is being set with open permissions: ugo+rw Sep 28 15:24:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:01 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 Sep 28 15:24:01 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" returned: 0 in 0.286s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:01 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.info Sep 28 15:24:01 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.info" returned: 0 in 0.324s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.info is being set with open permissions: ugo+rw Sep 28 15:24:01 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:01 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.info Sep 28 15:24:01 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:02 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.info" returned: 0 in 0.289s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:02 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:02 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-07bd1583-11ae-400e-bd3d-34836703540f tempest-ProjectMemberTests-1666069766 None] Create snapshot completed successfully Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-22a3edfb-a9d2-4916-8e22-9b9f6e1b9548-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Lock "cinder-22a3edfb-a9d2-4916-8e22-9b9f6e1b9548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Deleting offline snapshot 22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 of volume fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] snapshot_file for this snap is: volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a6ba1-91ab-4c66-b88f-6dd1320ec899]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:03 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 Sep 28 15:24:03 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:03 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" returned: 0 in 0.397s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[390790b8-660a-4a1b-8d0e-c133ba10957e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:03 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:03 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 Sep 28 15:24:03 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Flow 'volume_create_manager' (823ba7ad-f357-4e42-a0bb-41ffc26dcd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ea4574-1540-4866-a17e-cc49edbf82f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ea4574-1540-4866-a17e-cc49edbf82f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287532741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea46a792-5eee-46fc-afb4-d66d3d31adea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527dfd1273434b8abf5543bdc53b1e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:04Z,use_quota=True,user_id='4357cfe080974cb2a237bbce3d39103b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57136e7d-9ba3-4a5e-a7cf-73a0fe44932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57136e7d-9ba3-4a5e-a7cf-73a0fe44932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ee5b4e-19dc-4cfd-82e0-2fd6bf82564c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:04 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ee5b4e-19dc-4cfd-82e0-2fd6bf82564c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea46a792-5eee-46fc-afb4-d66d3d31adea', 'volume_name': 'volume-ea46a792-5eee-46fc-afb4-d66d3d31adea', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13066cd9-2342-41f7-b8db-1900097ab1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13066cd9-2342-41f7-b8db-1900097ab1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a97d1cf-2d03-450b-bed4-5973047bad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:04 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Volume ea46a792-5eee-46fc-afb4-d66d3d31adea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea46a792-5eee-46fc-afb4-d66d3d31adea', 'volume_size': 1} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287532741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea46a792-5eee-46fc-afb4-d66d3d31adea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527dfd1273434b8abf5543bdc53b1e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:04Z,use_quota=True,user_id='4357cfe080974cb2a237bbce3d39103b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Creating volume ea46a792-5eee-46fc-afb4-d66d3d31adea {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:04 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" returned: 0 in 0.414s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea 1073741824 Sep 28 15:24:04 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 Sep 28 15:24:04 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" returned: 0 in 0.335s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548 Sep 28 15:24:04 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea 1073741824" returned: 0 in 0.454s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea Sep 28 15:24:04 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07.22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" returned: 0 in 0.295s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-22a3edfb-a9d2-4916-8e22-9b9f6e1b9548" released by "_delete_snapshot" :: held 1.573s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:04 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" released by "delete_snapshot" :: held 1.599s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Created reservations ['6755be1e-cb4d-4234-9ce1-1a209c672e8f', '7ef463ea-8691-46d6-b663-3a7a31f0d90f', 'beb7f9c7-02d0-4a8c-a226-824d947e7beb', 'df108ad6-1b95-447e-9172-c114fee6f1f5'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:05 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea" returned: 0 in 0.268s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a97d1cf-2d03-450b-bed4-5973047bad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea46a792-5eee-46fc-afb4-d66d3d31adea', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8137030c-5b2d-4e87-8062-da17250700db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:05 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Volume volume-ea46a792-5eee-46fc-afb4-d66d3d31adea (ea46a792-5eee-46fc-afb4-d66d3d31adea): created successfully Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8137030c-5b2d-4e87-8062-da17250700db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Flow 'volume_create_manager' (823ba7ad-f357-4e42-a0bb-41ffc26dcd0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-12686ded-fae8-4925-ae67-6119f6cf77c7 tempest-ProjectReaderTests-2135462637 None] Created volume successfully. Sep 28 15:24:05 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Delete snapshot completed successfully. Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-38d41705-6770-4a7d-b5a1-2184519f8fce tempest-ProjectMemberTests-1666069766 None] Lock "cinder-22a3edfb-a9d2-4916-8e22-9b9f6e1b9548-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Acquiring lock "cinder-ea46a792-5eee-46fc-afb4-d66d3d31adea-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Lock "cinder-ea46a792-5eee-46fc-afb4-d66d3d31adea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Acquiring lock "cinder-quobyte-ea46a792-5eee-46fc-afb4-d66d3d31adea" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Lock "cinder-quobyte-ea46a792-5eee-46fc-afb4-d66d3d31adea" acquired by "delete_volume" :: waited 0.020s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd993804-7aca-4317-b7df-001110fb9a73]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-fffe6e9a-06c4-4793-b89f-d4a0a539ef07-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-fffe6e9a-06c4-4793-b89f-d4a0a539ef07-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "cinder-quobyte-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" acquired by "delete_volume" :: waited 0.022s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:05 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea Sep 28 15:24:05 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ef0ab-87dd-42c8-80a2-de42fc52a324]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:05 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 Sep 28 15:24:05 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:05 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea" returned: 0 in 0.434s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:05 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:05 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea Sep 28 15:24:05 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" returned: 0 in 0.394s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07 Sep 28 15:24:06 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-ea46a792-5eee-46fc-afb4-d66d3d31adea" returned: 0 in 0.285s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Lock "cinder-quobyte-ea46a792-5eee-46fc-afb4-d66d3d31adea" released by "delete_volume" :: held 0.781s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Created reservations ['fa12e009-38d5-4bd9-8e93-7c33fcb99b8c', 'be84d604-cfb8-47e2-a89f-70f16acc9c6c', '22ee16ac-d66b-4eb9-9346-990b9ed9d1b2', '97493668-bcdb-4061-b534-c0a2f7f03503'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:06 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" returned: 0 in 0.291s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-quobyte-fffe6e9a-06c4-4793-b89f-d4a0a539ef07" released by "delete_volume" :: held 0.770s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:24:06 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Created reservations ['86683b38-869c-48cc-9068-ed06f564ec0e', '81e82082-1121-4e1c-9339-f1015fd9f795', '70713f71-5326-456a-ab81-21709d2eb98a', 'ae74bd3c-075a-435f-bbfe-9b5465c9a292'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:24:06 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.369s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Deleted volume successfully. Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-865017dd-347b-4350-ab13-ecc272f085ff tempest-ProjectReaderTests-2135462637 None] Lock "cinder-ea46a792-5eee-46fc-afb4-d66d3d31adea-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:06 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.329s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:06 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Deleted volume successfully. Sep 28 15:24:06 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-0baea831-30af-4ddb-8085-a7702c22db58 tempest-ProjectMemberTests-1666069766 None] Lock "cinder-fffe6e9a-06c4-4793-b89f-d4a0a539ef07-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Flow 'volume_create_manager' (7541d0cd-a30b-42f9-8764-3c1b15ba695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8096c893-51a6-4252-b1ca-339b75e3c865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8096c893-51a6-4252-b1ca-339b75e3c865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092049629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b821e4ed-34f2-463f-bb61-48142f8fd495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527dfd1273434b8abf5543bdc53b1e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:07Z,use_quota=True,user_id='4357cfe080974cb2a237bbce3d39103b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14627bfd-e352-4d43-b4e3-1e48ba7a62e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14627bfd-e352-4d43-b4e3-1e48ba7a62e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe9ef44-23e7-4095-afa5-14a132393d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe9ef44-23e7-4095-afa5-14a132393d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b821e4ed-34f2-463f-bb61-48142f8fd495', 'volume_name': 'volume-b821e4ed-34f2-463f-bb61-48142f8fd495', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35076d55-6ccb-4301-a071-9d7e63919a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35076d55-6ccb-4301-a071-9d7e63919a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b37361-d9db-4728-b28a-2c2c0444b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:07 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Volume b821e4ed-34f2-463f-bb61-48142f8fd495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b821e4ed-34f2-463f-bb61-48142f8fd495', 'volume_size': 1} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092049629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b821e4ed-34f2-463f-bb61-48142f8fd495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527dfd1273434b8abf5543bdc53b1e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:07Z,use_quota=True,user_id='4357cfe080974cb2a237bbce3d39103b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Creating volume b821e4ed-34f2-463f-bb61-48142f8fd495 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:07 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 1073741824 Sep 28 15:24:07 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 1073741824" returned: 0 in 0.508s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:07 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 Sep 28 15:24:07 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495" returned: 0 in 0.270s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:08 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b37361-d9db-4728-b28a-2c2c0444b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b821e4ed-34f2-463f-bb61-48142f8fd495', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36077569-0ddf-4c3c-a69c-aab55e279c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:08 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Volume volume-b821e4ed-34f2-463f-bb61-48142f8fd495 (b821e4ed-34f2-463f-bb61-48142f8fd495): created successfully Sep 28 15:24:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36077569-0ddf-4c3c-a69c-aab55e279c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:08 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Flow 'volume_create_manager' (7541d0cd-a30b-42f9-8764-3c1b15ba695f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:08 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-79fd20aa-a249-4b29-b926-b8ae87c0350c tempest-ProjectReaderTests-2135462637 None] Created volume successfully. Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Acquiring lock "cinder-b821e4ed-34f2-463f-bb61-48142f8fd495-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Lock "cinder-b821e4ed-34f2-463f-bb61-48142f8fd495-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Acquiring lock "cinder-quobyte-b821e4ed-34f2-463f-bb61-48142f8fd495" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Lock "cinder-quobyte-b821e4ed-34f2-463f-bb61-48142f8fd495" acquired by "delete_volume" :: waited 0.019s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6b867-307c-4e9b-bae2-6afc060afc6d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:09 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 Sep 28 15:24:09 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:09 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495" returned: 0 in 0.438s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:09 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:09 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495 Sep 28 15:24:09 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:10 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-b821e4ed-34f2-463f-bb61-48142f8fd495" returned: 0 in 0.338s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Lock "cinder-quobyte-b821e4ed-34f2-463f-bb61-48142f8fd495" released by "delete_volume" :: held 0.832s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Created reservations ['5c3cfa98-b105-4638-9965-243c5d45867d', 'bc814b3d-f2af-47c6-97f0-f4365e1bbb1d', 'afba0d87-9a23-4979-9808-b60eefd6f9a6', 'f6c47eeb-f37b-41ac-b0e4-afbe8072b609'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:10 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:24:10 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:10 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.296s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:10 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Deleted volume successfully. Sep 28 15:24:10 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a8f9d103-413e-474d-82b2-8c7ec29056b3 tempest-ProjectReaderTests-2135462637 None] Lock "cinder-b821e4ed-34f2-463f-bb61-48142f8fd495-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:20 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=39,cinder:INSERT=20,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:20 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=60,cinder:SELECT=34,cinder:INSERT=8,cinder:DELETE=6 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:33 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:33 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:33 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:33 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:24:33 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:34 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:34 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.296s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:34 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:34 devstack cinder-volume[86384]: DEBUG oslo_service.periodic_task [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] Running periodic task VolumeManager._thread_info {{(pid=86384) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread count: 29 {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:24:34 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-f12f3217-d5a3-432c-89d3-d74cf3ee4754 None None] thread info: [<_MainThread(MainThread, started 133747421827200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86384) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Flow 'volume_create_manager' (75d8db35-d08c-4e7d-881f-d7155b0e2bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177194ad-3937-4b70-8112-e499882151b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177194ad-3937-4b70-8112-e499882151b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-389274824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b8ac20-0f34-44a3-a18f-0388a91830d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69291311e41428aa08dea4f8e518811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='0b149f0ccb024d35947a2882c0d7caa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a2edc7-97c9-4ea7-a8fd-9167f6d2ebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a2edc7-97c9-4ea7-a8fd-9167f6d2ebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ff2a23-ed15-453f-8952-95240061c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ff2a23-ed15-453f-8952-95240061c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b8ac20-0f34-44a3-a18f-0388a91830d7', 'volume_name': 'volume-44b8ac20-0f34-44a3-a18f-0388a91830d7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff087d78-fe34-432c-84ac-6fa5f4d20832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff087d78-fe34-432c-84ac-6fa5f4d20832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7e010e-7006-45ae-914f-bf5df02d7b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Volume 44b8ac20-0f34-44a3-a18f-0388a91830d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b8ac20-0f34-44a3-a18f-0388a91830d7', 'volume_size': 1} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-389274824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b8ac20-0f34-44a3-a18f-0388a91830d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69291311e41428aa08dea4f8e518811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='0b149f0ccb024d35947a2882c0d7caa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)}" {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Creating volume 44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:39 devstack cinder-volume[86384]: INFO cinder.volume.drivers.remotefs [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] casted to osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d Sep 28 15:24:39 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 1073741824 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:39 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 1073741824 Sep 28 15:24:39 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 1073741824" returned: 0 in 0.470s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 Sep 28 15:24:40 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7" returned: 0 in 0.254s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'} {{(pid=86384) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7e010e-7006-45ae-914f-bf5df02d7b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b8ac20-0f34-44a3-a18f-0388a91830d7', 'volume_size': 1}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318f9955-66e1-49c7-bb20-3146356f3ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Volume volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 (44b8ac20-0f34-44a3-a18f-0388a91830d7): created successfully Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318f9955-66e1-49c7-bb20-3146356f3ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Flow 'volume_create_manager' (75d8db35-d08c-4e7d-881f-d7155b0e2bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:40 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-527e493b-261a-4831-b787-65446df9a4a2 tempest-SnapshotDependencyTests-578259930 None] Created volume successfully. Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Creating offline snapshot b6a8506d-de8a-4336-b867-75a0c3119bb3 of volume 44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52ddf4d-03e5-45f8-9275-75b7656bc6b3]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 Sep 28 15:24:41 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:41 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7" returned: 0 in 0.391s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 1G {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 1G Sep 28 15:24:41 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:41 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 1G" returned: 0 in 0.411s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 Sep 28 15:24:41 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 -F qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3" returned: 0 in 0.326s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 is being set with open permissions: ugo+rw Sep 28 15:24:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 Sep 28 15:24:42 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3" returned: 0 in 0.362s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.info Sep 28 15:24:42 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.info" returned: 0 in 0.316s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.info is being set with open permissions: ugo+rw Sep 28 15:24:42 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.info {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.info Sep 28 15:24:42 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.info" returned: 0 in 0.270s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:43 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-35dd1ee1-363b-47c1-ac5d-fc9d231f27e6 tempest-SnapshotDependencyTests-578259930 None] Create snapshot completed successfully Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86384) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Flow 'volume_create_manager' (07f5e342-a84c-469d-9cb9-a329244b72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a24670f-fe7f-4a38-b8b8-770871edc938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a24670f-fe7f-4a38-b8b8-770871edc938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f190c4-20d6-4569-9b02-719360af6157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69291311e41428aa08dea4f8e518811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6a8506d-de8a-4336-b867-75a0c3119bb3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:45Z,use_quota=True,user_id='0b149f0ccb024d35947a2882c0d7caa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcd09e71-1143-4f6c-9f7d-1c351a69bc3a),volume_type_id=dcd09e71-1143-4f6c-9f7d-1c351a69bc3a)' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a549cf2d-b52e-46e9-b3ce-64490830807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a549cf2d-b52e-46e9-b3ce-64490830807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d6f089-656d-4ad9-b287-7deceabfa29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d6f089-656d-4ad9-b287-7deceabfa29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68f190c4-20d6-4569-9b02-719360af6157', 'volume_name': 'volume-68f190c4-20d6-4569-9b02-719360af6157', 'volume_size': 1, 'snapshot_id': 'b6a8506d-de8a-4336-b867-75a0c3119bb3'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902aaf10-5934-4079-9c89-891d3b0231e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902aaf10-5934-4079-9c89-891d3b0231e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a934a89f-f466-4008-a00a-547bb28f069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:44 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Volume 68f190c4-20d6-4569-9b02-719360af6157: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68f190c4-20d6-4569-9b02-719360af6157', 'volume_size': 1, 'snapshot_id': 'b6a8506d-de8a-4336-b867-75a0c3119bb3'} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-quobyte-b6a8506d-de8a-4336-b867-75a0c3119bb3-68f190c4-20d6-4569-9b02-719360af6157" by "_create_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-b6a8506d-de8a-4336-b867-75a0c3119bb3-68f190c4-20d6-4569-9b02-719360af6157" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Creating volume 68f190c4-20d6-4569-9b02-719360af6157 from snapshot b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Selected osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d as target Quobyte volume. {{(pid=86384) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-quobyte-68f190c4-20d6-4569-9b02-719360af6157" by "_copy_volume_from_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-68f190c4-20d6-4569-9b02-719360af6157" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] snapshot: b6a8506d-de8a-4336-b867-75a0c3119bb3, volume: 68f190c4-20d6-4569-9b02-719360af6157, {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e72f73-828c-49f9-b035-21380f8ad86d]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:44 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:45 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 Sep 28 15:24:45 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:45 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3" returned: 0 in 0.383s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44b8ac20-0f34-44a3-a18f-0388a91830d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f8adc8-cdd0-466c-a851-4ad9734d4c3f]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:45 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 Sep 28 15:24:45 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:45 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7" returned: 0 in 0.389s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Creating direct copy from snapshot {{(pid=86384) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG cinder.utils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Path /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 not found in is_blk_device check {{(pid=86384) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:24:45 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:45 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 Sep 28 15:24:45 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157" returned: 0 in 5.759s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG cinder.image.image_utils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Image conversion details: src /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 {{(pid=86384) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:24:51 devstack cinder-volume[86384]: INFO cinder.image.image_utils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Converted 1024.00 MB image at 177.77 MB/s Sep 28 15:24:51 devstack cinder-volume[86384]: WARNING cinder.volume.drivers.remotefs [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 is being set with open permissions: ugo+rw Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 Sep 28 15:24:51 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157" returned: 0 in 0.229s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-68f190c4-20d6-4569-9b02-719360af6157" released by "_copy_volume_from_snapshot" :: held 6.843s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-b6a8506d-de8a-4336-b867-75a0c3119bb3-68f190c4-20d6-4569-9b02-719360af6157" released by "_create_volume_from_snapshot" :: held 6.913s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.927s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a934a89f-f466-4008-a00a-547bb28f069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f190c4-20d6-4569-9b02-719360af6157', 'volume_size': 1, 'snapshot_id': 'b6a8506d-de8a-4336-b867-75a0c3119bb3'}' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e1e493-a6e9-47b6-99cb-238958a27e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:51 devstack cinder-volume[86384]: INFO cinder.volume.flows.manager.create_volume [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Volume volume-68f190c4-20d6-4569-9b02-719360af6157 (68f190c4-20d6-4569-9b02-719360af6157): created successfully Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e1e493-a6e9-47b6-99cb-238958a27e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86384) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:51 devstack cinder-volume[86384]: DEBUG cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Flow 'volume_create_manager' (07f5e342-a84c-469d-9cb9-a329244b72f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86384) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:51 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-ef35fc46-5a6d-4373-b3f2-dce9bfa77d35 tempest-SnapshotDependencyTests-578259930 None] Created volume successfully. Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-b6a8506d-de8a-4336-b867-75a0c3119bb3-delete_snapshot" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-b6a8506d-de8a-4336-b867-75a0c3119bb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-quobyte-44b8ac20-0f34-44a3-a18f-0388a91830d7" by "delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-44b8ac20-0f34-44a3-a18f-0388a91830d7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-quobyte-b6a8506d-de8a-4336-b867-75a0c3119bb3" by "_delete_snapshot" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-b6a8506d-de8a-4336-b867-75a0c3119bb3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Deleting offline snapshot b6a8506d-de8a-4336-b867-75a0c3119bb3 of volume 44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] snapshot_file for this snap is: volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee9a543-b95f-4942-9f05-9d14af6b138e]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:52 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 Sep 28 15:24:52 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:52 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3" returned: 0 in 0.397s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.remotefs [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44b8ac20-0f34-44a3-a18f-0388a91830d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86384) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd2ce3-44d2-44b8-b45c-6eaef7790a10]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:52 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:53 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 Sep 28 15:24:53 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:53 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7" returned: 0 in 0.614s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:53 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 Sep 28 15:24:53 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:53 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3" returned: 0 in 0.348s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:53 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:53 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3 Sep 28 15:24:53 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7.b6a8506d-de8a-4336-b867-75a0c3119bb3" returned: 0 in 0.236s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-b6a8506d-de8a-4336-b867-75a0c3119bb3" released by "_delete_snapshot" :: held 1.708s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-44b8ac20-0f34-44a3-a18f-0388a91830d7" released by "delete_snapshot" :: held 1.734s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Created reservations ['8b4e99cb-32cf-46cb-b1cf-0efefea1b7d1', '7d4f969e-46b2-4237-a8e6-050cc021bb19', '9a8963dd-4ff5-4fc1-8026-f5849cec7a8b', '8a75b391-7aa8-4ae0-a45f-8e73ff6aa548'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:54 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Delete snapshot completed successfully. Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-a469d5fc-b515-4ff7-83c7-3cc2b92522b8 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-b6a8506d-de8a-4336-b867-75a0c3119bb3-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-44b8ac20-0f34-44a3-a18f-0388a91830d7-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-44b8ac20-0f34-44a3-a18f-0388a91830d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-quobyte-44b8ac20-0f34-44a3-a18f-0388a91830d7" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-44b8ac20-0f34-44a3-a18f-0388a91830d7" acquired by "delete_volume" :: waited 0.017s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9320e6-bb6c-45f8-ab1d-9aa9d4f8c3de]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:54 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 Sep 28 15:24:54 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7" returned: 0 in 0.362s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7 Sep 28 15:24:55 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-44b8ac20-0f34-44a3-a18f-0388a91830d7" returned: 0 in 0.245s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-44b8ac20-0f34-44a3-a18f-0388a91830d7" released by "delete_volume" :: held 0.670s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Created reservations ['4ff0a791-1a58-4391-9cfd-58559b0ad997', 'b39de3fa-143f-4305-903d-c348fa423db5', 'af107a34-f13d-44f3-be88-6a44cd1de9e4', '94a7f898-5e86-47f3-81e1-1bfd1e4147b4'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:24:55 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.254s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:55 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Deleted volume successfully. Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-e187f37c-cb9d-401b-b0b0-feb2de9db4ba tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-44b8ac20-0f34-44a3-a18f-0388a91830d7-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-68f190c4-20d6-4569-9b02-719360af6157-delete_volume" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-68f190c4-20d6-4569-9b02-719360af6157-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "cinder-quobyte-68f190c4-20d6-4569-9b02-719360af6157" by "delete_volume" {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-68f190c4-20d6-4569-9b02-719360af6157" acquired by "delete_volume" :: waited 0.016s {{(pid=86384) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a4cc98-01de-4bfa-a77a-60bae9850e74]: (4, 'qcow2') {{(pid=87498) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:55 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 Sep 28 15:24:55 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:56 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157" returned: 0 in 0.413s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:56 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157 Sep 28 15:24:56 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:56 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c/volume-68f190c4-20d6-4569-9b02-719360af6157" returned: 0 in 0.261s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-quobyte-68f190c4-20d6-4569-9b02-719360af6157" released by "delete_volume" :: held 0.719s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG cinder.quota [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Created reservations ['47d60077-4054-425e-8543-e4f70e6ea68f', '29964976-a01d-441c-9e83-9a2aa943dde0', '5546d4ea-7328-4c5b-b365-3ef7f7409e45', '58b40eea-ab0d-4cc4-85f4-4d9d68129104'] {{(pid=86384) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d': None} {{(pid=86384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG cinder.volume.drivers.quobyte [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b2b3cc3d-51de-4f28-8d64-139e73a2882d'] {{(pid=86384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.lockutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86384) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:56 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c Sep 28 15:24:56 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:56 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG oslo_concurrency.processutils [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9296709362661854ad5a7c0b78a3326c" returned: 0 in 0.257s {{(pid=86384) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG cinder.manager [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Notifying Schedulers of capabilities ... {{(pid=86384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:56 devstack cinder-volume[86384]: INFO cinder.volume.manager [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Deleted volume successfully. Sep 28 15:24:56 devstack cinder-volume[86384]: DEBUG cinder.coordination [None req-afa1a8b5-f6ad-4297-8397-32dde1659118 tempest-SnapshotDependencyTests-578259930 None] Lock "cinder-68f190c4-20d6-4569-9b02-719360af6157-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86384) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:06 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:UPDATE=25,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:25:06 devstack cinder-volume[86384]: DEBUG dbcounter [-] [86384] Writing DB stats cinder:SELECT=28,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86384) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}